> Markdown version of [/jobs/ext/2229395-azure-databricks-architect](https://www.wearedevelopers.com/jobs/ext/2229395-azure-databricks-architect). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Azure Databricks Architect

- **Company:** System Soft
- **Location:** San Francisco, CA, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Amazon Web Services, Microsoft Azure, Continuous Integration, Information Engineering, Extract Transform Load (ETL), Data Systems, Data Warehousing, DevOps, Memory Management, Github, Machine Learning, Performance Tuning, Cloud Services, Data Streaming, Google Cloud, Apache Spark, Data Lakes, Gitlab-ci, Data Analytics, Data Management, Machine Learning Operations, Data Pipelines, Jenkins, Databricks
- **Published:** August 25, 2026
- **Apply:** https://www.dice.com/job-detail/aaf77747-be1c-4745-9029-dc5fa1dc63f7

## About the Role

* 12-15+ years of experience in Data Engineering, Data Platforms, Data Analytics, and Modern Data Warehouse solutions, with 10+ years of overall consulting and client-facing delivery experience.
 * Demonstrated success delivering 6-8+ end-to-end Databricks implementations, serving as a hands-on developer, technical lead, or solution architect.
 * Databricks Data Engineering Professional certification with completion of all recommended learning paths and coursework.
 * Databricks has a Databricks Solutions Architect Champion program- this will be good to have
 * Strong expertise in designing and implementing cloud-native data platforms across AWS, Azure, and/or Google Cloud Platform, with deep hands-on proficiency in at least one cloud ecosystem.
 * Advanced knowledge of Apache Spark, including performance optimization, partitioning strategies, execution plans, memory management, and Spark runtime internals.
 * Extensive hands-on experience developing scalable ETL/ELT pipelines using Databricks, Delta Lake, Structured Streaming, and modern data engineering frameworks.
 * Experience implementing DevOps and CI/CD practices for production-grade data solutions using tools such as Azure DevOps, GitHub Actions, GitLab CI/CD, or Jenkins.
 * Working knowledge of MLOps principles, machine learning lifecycle management, model deployment, and monitoring within enterprise environments.
 * Current and broad understanding of the Databricks Lakehouse Platform, including Delta Lake, Unity Catalog, Workflows, MLflow, Delta Live Tables, and other platform capabilities.



## Related Videos

- [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering)
- [The Road to MLOps: How Verivox Transitioned to AWS](https://www.wearedevelopers.com/videos/1050-the-road-to-mlops-how-verivox-transitioned-to-aws)
- [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next)
- [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Our GitOps approach for deploying an Identity Provider and an API Gateway in a SaaS company](https://www.wearedevelopers.com/videos/776-our-gitops-approach-for-deploying-an-identity-provider-and-an-api-gateway-in-a-saas-company)

## Related Articles

- [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)