> Markdown version of [/jobs/ext/4717666-azure-data-engineer-adf-databricks](https://www.wearedevelopers.com/jobs/ext/4717666-azure-data-engineer-adf-databricks). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Azure Data Engineer (ADF & Databricks)

- **Company:** Diverse Lynx LLC
- **Location:** Houston, TX, United States
- **Experience:** Experienced
- **Salary:** $104,000
- **Contract:** Permanent contract
- **Skills:** Agile Methodology, Unit Testing, Microsoft Azure, Big Data, Computer Programming, Continuous Integration, Information Engineering, Data Files, Data Mapping, Data Transformation, Python (Programming Language), Query Optimization, Azure Data Lake, SQL Databases, Data Streaming, User Interface Testing, Parquet, Data Storage Technologies, Azure Data Factory, Git, Modularization, Pytest, Data Lakes, Pyspark, Git Flow, Data Management, Software Coding, Databricks
- **Published:** November 14, 2026
- **Apply:** https://www.careerbuilder.com/job-details/azure-data-engineer-adf-databricks-houston-tx--f2d88e38-2499-4140-afbe-0e1e876921ec

## About the Role

Microsoft Windows Azure, Microsoft Windows Azure, Error Handling, Data Management, Data Mapping, SQL (Structured Query Language), Data Sets, Agile Programming Methodologies, Git, Pytest, Azure Data Factory Pipelines, data flows (mapping wrangling), triggers, integration runtimes, parameterization, error handling & retries.

Azure Databricks Databricks Notebooks, Jobs Workflows, PySpark Scala, Delta Lake, cluster configuration and Eligible to workimization.

SQL Expert level SQL (CTEs, window functions, query tuning), working with large datasets.

Nice to have skills

Agile

Infrastructure as Code exposure is a plus.

Detailed Job Description

Experience 6-8 years in data engineering with at least 3 years on Azure. Azure Data Factory Pipelines, data flows mapping wrangling, triggers, integration runtimes, parameterization, error handling retries. Azure Databricks Databricks Notebooks, Jobs Workflows, PySpark Scala, Delta Lake, cluster configuration and Eligible to workimization. Programming Advanced Python or Scala at least one, strong coding standards, modularization, and unit testing e.g., pytest. SQL Expert level SQL CTEs, window functions, query tuning, working with large datasets. Data Storage Formats ADLS Gen2, Delta Lake, Parquet, partitioning, ZOrdering, Eligible to workIMIZE VACUUM. Ops CICD Git, branching strategies, CICD for ADF Databricks environment promotion Infrastructure as Code exposure is a plus.

Minimum years of experience: 8-10 years

Certifications Needed :No

Top 3 responsibilities you would expect the Subcon to shoulder and execute

Coding and Development

UI testing

Stakeholder management