> Markdown version of [/jobs/ext/2448234-azure-databricks-engineer-lead](https://www.wearedevelopers.com/jobs/ext/2448234-azure-databricks-engineer-lead). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Azure Databricks Engineer / Lead - **Company:** HMG America - **Location:** Dallas, TX, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Microsoft Azure, Code Review, Computer Programming, Continuous Integration, Data Architecture, Information Engineering, Extract Transform Load (ETL), Data Systems, DevOps, Apache Hive, Python (Programming Language), Key Management, Performance Tuning, Azure Data Lake, SQL Databases, Azure Data Factory, Apache Spark, Git, Data Lakes, Pyspark, Optimization Algorithms, Deployment Automation, Terraform, Azure Synapse Analytics, Software Version Control, Data Pipelines, Databricks - **Published:** August 28, 2026 - **Apply:** https://www.dice.com/job-detail/c1be9c4d-3995-46e3-a676-a64a0adafe2f ## About the Role * 8+ years of overall Data Engineering experience. * Strong hands-on experience with Azure Databricks. * Expert-level knowledge of PySpark and Spark SQL. * Strong programming experience in Python and SQL. * Experience with Delta Lake and Lakehouse architecture. * Strong experience with Azure Data Lake Storage (ADLS Gen2). * Experience with Azure Data Factory (ADF) and other Azure data services. * Strong understanding of ETL/ELT, data modeling, and large-scale data pipelines. * Experience with performance tuning and optimization in Databricks/Spark. * Experience with Git, CI/CD, and DevOps practices. * Excellent communication and stakeholder management skills. Preferred Skills * Databricks certifications. * Experience with Unity Catalog and Databricks governance/security. * Experience with Terraform or Infrastructure as Code. * Knowledge of Azure DevOps. * Experience working in a consulting or client-facing environment. ## Description We are seeking an experienced Azure Databricks Engineer / Lead to join our team in Dallas, TX. The ideal candidate will have strong hands-on experience designing and building scalable data engineering solutions using Azure Databricks, PySpark, Python, SQL, and Azure Data Services., * Design, develop, and implement scalable data pipelines using Azure Databricks. * Build and optimize ETL/ELT pipelines using PySpark, Python, and SQL. * Develop data solutions using the Medallion Architecture (Bronze, Silver, and Gold layers). * Work with Delta Lake, Delta tables, and advanced Databricks optimization techniques. * Integrate Databricks with Azure services such as ADLS Gen2, Azure Data Factory, Azure Synapse, and Azure Key Vault. * Develop and manage Databricks Workflows, Jobs, and Notebooks. * Implement data quality, monitoring, error handling, and performance optimization. * Collaborate with Data Architects, Data Engineers, Data Scientists, and business stakeholders. * Establish best practices for CI/CD, Git/version control, code reviews, and automated deployments. * Lead technical discussions and provide guidance to junior engineers. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) ## Related Articles - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Everything a Developer Needs to Know About MCP with Neo4j](https://www.wearedevelopers.com/magazine/604-everything-a-developer-needs-to-know-about-mcp-with-neo4j) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)