> Markdown version of [/jobs/ext/2189357-azure-databricks-engineer](https://www.wearedevelopers.com/jobs/ext/2189357-azure-databricks-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Azure Databricks Engineer

- **Company:** Zeus Inc
- **Location:** Houston, TX, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Big Data, Code Review, Computer Programming, Information Engineering, Data Governance, Extract Transform Load (ETL), Data Systems, Distributed Computing Environment, Distributed Systems, Performance Tuning, Data Streaming, Azure Data Factory, Apache Spark, Reliability of Systems, Pyspark, Performance Monitor, Stream Processing, Data Pipelines, Databricks
- **Published:** August 22, 2026
- **Apply:** https://www.wayup.com/i-j-Azure-Databricks-Engineer-ZEUS-SOLUTIONS-INC-962967094104014/

## About the Role

8+ years of hands-on experience in data engineering, big data development, or a related field
Extensive hands-on experience with Azure Databricks and PySpark
Strong programming background and in-depth knowledge of distributed data processing beyond traditional ETL tools
Proven expertise in:
Spark performance tuning and optimization
Cost management within Databricks
Structured Streaming for real-time data processing
Lakehouse Declarative Pipelines (LDP) and Delta Live Tables (DLT)
Familiarity with the Azure data ecosystem, including ADLS, Azure Data Factory, and Synapse
Excellent communication skills and the ability to collaborate effectively with cross-functional teams
Willingness and ability to work onsite in Houston
Nice-to-Have Qualifications
Industry experience in energy, utilities, or heavy industry
Knowledge of data governance, security, and monitoring

## Description

We are seeking a highly skilled, hands-on Databricks Lead with 8+ years of experience in data engineering, including deep expertise in Azure Databricks, PySpark, and Structured Streaming. This role is ideal for a senior engineer with a programming-first mindset, a strong understanding of distributed systems, and the ability to build high-performance, cost-optimized data solutions.
This is not a traditional ETL role. It requires extensive knowledge of Spark internals, declarative pipeline development, and real-time data processing. The successful candidate will also provide technical leadership and collaborate closely with cross-functional teams to deliver robust, scalable data solutions., Lead the design and development of scalable, high-performance data pipelines, streaming tables, and Delta Live Tables (DLT) using Azure Databricks and PySpark
Drive Spark performance tuning and implement cost-optimization strategies within the Databricks environment
Build and manage real-time and batch workflows using Structured Streaming
Leverage Delta Live Tables (DLT) and Lakehouse Declarative Pipelines (LDP) to build scalable, reliable, and maintainable data pipelines
Collaborate with data architects, analysts, and business stakeholders to deliver robust data solutions
Provide technical leadership through mentorship, code reviews, and architectural guidance
Ensure system reliability and performance through proactive monitoring and engineering best practices


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)
- [OLTP in the Lakehouse: Redefining Data for AI Workloads](https://www.wearedevelopers.com/videos/2038-oltp-in-the-lakehouse-redefining-data-for-ai-workloads)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)

## Related Articles

- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)