> Markdown version of [/jobs/ext/1921252-data-engineer](https://www.wearedevelopers.com/jobs/ext/1921252-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Databricks - **Location:** Atlanta, GA, United States - **Contract:** Permanent contract - **Skills:** Query Performance, Artificial Intelligence, Automation of Tests, Microsoft Azure, Cluster Analysis, Code Review, Continuous Integration, Data Architecture, Extract Transform Load (ETL), Data Structures, Data Warehousing, DevOps, Dimensional Modeling, Github, Python (Programming Language), Key Management, Role-Based Access Control, Azure Data Lake, Autoscaling, Data Layers, Information Technology, Data Lineage, Software Version Control, Serverless Computing, Key Vault, Databricks, Programming Languages - **Published:** August 4, 2026 - **Apply:** https://www.dice.com/job-detail/390ee574-224c-43e2-96b1-ea04ed5408e0 ## About the Role Bachelor s degree in computer science, Information Technology, or related field Strong hands-on knowledge of Azure Databricks and the Azure platform, with proven experience operating a production Lakehouse at scale Proficiency in Databricks SQL, Python, and other relevant programming languages. Deep Azure knowledge: ADLS Gen2, Key Vault, Networking (VNet/Private Endpoints), Event Hub Deep understanding of advanced data warehouse concepts (dimensional modeling, SCD, surrogate key management) is required Experience with data modeling, dimensional modeling, and temporal data structures in an operational ETL environment Unity Catalog security & lineage. Strong business problem framing and stakeholder communication. Experience establishing engineering standards, performing design/code reviews, and mentoring data engineers Excellent problem-solving and communication skills Ability to work independently and collaboratively in a fast-paced environment. ## Description Responsible for supporting and evolving the Azure Databricks Lakehouse architecture of an established Data Warehouse team setting design standards, governing the platform, unlocking full Databricks/Databricks AI capabilities, and optimizing solutions for performance, cost, security, and scalability. What will your job look like? You will act as the technical design authority for an existing Databricks ETL team, working alongside customer business, development, Databricks, and DevOps teams. You will support and evolve the production Lakehouse architecture: Delta medallion layers, Databricks SQL Warehouses, Unity Catalog security, and data lineage. You will define and enforce design standards, reusable patterns, and best practices across the existing pipeline estate and all new development You will design new ingestion, streaming, and batch pipelines and review team designs against the medallion (bronze/silver/gold) architecture. You will drive continuous optimization of the running platform: cluster sizing, autoscaling, Photon usage (if decided), query performance, Delta Liquid Clustering/Z-Ordering, VACUUM strategies, and DBU cost governance You will translate business questions into analytical models, KPIs, and reusable semantic layers. You will mature CI/CD (Azure DevOps/GitHub), observability, and security (RBAC, row/column-level policies) across existing pipelines. You will evaluate and drive adoption of new Databricks capabilities (Lakeflow, Delta Live Tables, serverless compute, AI/BI) where they add value. You will conduct architectural reviews, code audits, and mentoring sessions to raise the team s engineering bar and ensure adherence to standards and scalability. You will guide the team in version control, automated testing, and release discipline for Databricks notebooks, jobs, and workflows. ## Related Videos - [Best Practices for Using GitHub Secrets](https://www.wearedevelopers.com/videos/1214-best-practices-for-using-github-secrets) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Develop enterprise-ready applications for Microsoft Teams with Azure resources on modern web technologies](https://www.wearedevelopers.com/videos/187-develop-enterprise-ready-applications-for-microsoft-teams-with-azure-resources-on-modern-web-technologies) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)