> Markdown version of [/jobs/ext/1386653-data-architect-azure-databricks](https://www.wearedevelopers.com/jobs/ext/1386653-data-architect-azure-databricks). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Architect (Azure + Databricks) - **Company:** CORE4 TECHNOLOGIES INCORPORATED - **Location:** Milpitas, CA, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Amazon Web Services, Microsoft Azure, Batch Processing, Code Review, Computer Programming, Continuous Integration, Data Architecture, Information Engineering, Data Governance, Data Infrastructure, Data Vault Modeling, DevOps, Dimensional Modeling, Python (Programming Language), Machine Learning, Meta-Data Management, Azure Data Lake, Scala (Programming Language), SQL Databases, Data Streaming, Azure Service Bus, Azure Data Factory, Apache Spark, Multi-Cloud, Data Lakes, Pyspark, Infrastructure Automation Frameworks, Collibra, Apache Kafka, Data Management, Machine Learning Operations, Data Lakehouse, Cloud Migration, Cloud Optimization, Terraform, Azure Synapse Analytics, Data Pipelines, Databricks - **Published:** July 22, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=118ef7e12d0743d7 ## About the Role If you're an architect who enjoys coding or a senior data engineer ready to lead architecture, we'd love to hear from you., * 8+ years of Data Engineering/Data Architecture experience. * Expert-level experience with Azure Data Services: * Azure Data Lake Storage (ADLS) * Azure Data Factory (ADF) * Azure Synapse Analytics * Azure Event Hubs * Azure Purview * Strong expertise in Databricks, including: * Delta Lake * Unity Catalog * Medallion Architecture * Cluster Optimization * Advanced Apache Spark performance tuning and optimization. * Strong coding experience in PySpark, Scala, Python, and advanced SQL. * Experience designing enterprise-scale data platforms and modern data lakehouse architectures. * Strong understanding of dimensional modeling, normalized models, and Data Vault. * Experience with Infrastructure as Code (Terraform/ARM), CI/CD, and DevOps practices. Preferred Qualifications * Azure Solutions Architect Expert Certification. * Databricks Certified Data Engineer Professional or Solutions Architect. * Experience with MLOps and Machine Learning platforms. * Cloud migration and modernization experience. * FinOps and cloud cost optimization knowledge. * Multi-cloud exposure (AWS/GCP) is a plus. * Consulting or advisory experience., * Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field. * Master's degree preferred. ## Description We are hiring an experienced Data Architect with deep expertise in Azure, Databricks, and Apache Spark to join a high-impact enterprise data transformation initiative. This is a hands-on architecture role where you'll be responsible for designing scalable data platforms while actively building, coding, and optimizing production-grade solutions., * Design scalable, secure, and cost-efficient enterprise data architectures on Azure and Databricks. * Build and implement modern data lakehouse solutions using Delta Lake and Medallion Architecture. * Develop production-grade data pipelines using PySpark, Scala, SQL, and Apache Spark. * Optimize Databricks clusters, Spark workloads, and platform performance. * Design streaming and batch processing solutions using Event Hubs, Kafka, and Structured Streaming. * Implement data governance, security, and metadata management using Unity Catalog and Azure Purview. * Conduct architecture reviews, code reviews, and mentor engineering teams. * Collaborate with business and technical stakeholders to translate requirements into scalable solutions. * Drive best practices around DevOps, Infrastructure as Code, CI/CD, testing, and observability. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) ## Related Articles - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)