Data Architect (Azure + Databricks)
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+26 more
Job description
We are hiring an experienced Data Architect with deep expertise in Azure, Databricks, and Apache Spark to join a high-impact enterprise data transformation initiative. This is a hands-on architecture role where you’ll be responsible for designing scalable data platforms while actively building, coding, and optimizing production-grade solutions., * Design scalable, secure, and cost-efficient enterprise data architectures on Azure and Databricks.
- Build and implement modern data lakehouse solutions using Delta Lake and Medallion Architecture.
- Develop production-grade data pipelines using PySpark, Scala, SQL, and Apache Spark.
- Optimize Databricks clusters, Spark workloads, and platform performance.
- Design streaming and batch processing solutions using Event Hubs, Kafka, and Structured Streaming.
- Implement data governance, security, and metadata management using Unity Catalog and Azure Purview.
- Conduct architecture reviews, code reviews, and mentor engineering teams.
- Collaborate with business and technical stakeholders to translate requirements into scalable solutions.
- Drive best practices around DevOps, Infrastructure as Code, CI/CD, testing, and observability.
Requirements
If you’re an architect who enjoys coding or a senior data engineer ready to lead architecture, we’d love to hear from you., * 8+ years of Data Engineering/Data Architecture experience.
- Expert-level experience with Azure Data Services:
- Azure Data Lake Storage (ADLS)
- Azure Data Factory (ADF)
- Azure Synapse Analytics
- Azure Event Hubs
- Azure Purview
- Strong expertise in Databricks, including:
- Delta Lake
- Unity Catalog
- Medallion Architecture
- Cluster Optimization
- Advanced Apache Spark performance tuning and optimization.
- Strong coding experience in PySpark, Scala, Python, and advanced SQL.
- Experience designing enterprise-scale data platforms and modern data lakehouse architectures.
- Strong understanding of dimensional modeling, normalized models, and Data Vault.
- Experience with Infrastructure as Code (Terraform/ARM), CI/CD, and DevOps practices.
Preferred Qualifications
- Azure Solutions Architect Expert Certification.
- Databricks Certified Data Engineer Professional or Solutions Architect.
- Experience with MLOps and Machine Learning platforms.
- Cloud migration and modernization experience.
- FinOps and cloud cost optimization knowledge.
- Multi-cloud exposure (AWS/GCP) is a plus.
- Consulting or advisory experience., * Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field.
- Master’s degree preferred.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.indeed.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Top Big Data Technologies That You Need to Know
Making Data Warehouses Fast: A Developer’s Story
Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?
Highest Paying Tech Companies for Developers