> Markdown version of [/jobs/ext/3096598-adf-data-engineer](https://www.wearedevelopers.com/jobs/ext/3096598-adf-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# ADF Data Engineer

- **Company:** Diverse Lynx LLC
- **Location:** Houston, TX, United States
- **Experience:** Expert
- **Salary:** $165,000.0 - $194,000.0
- **Contract:** Permanent contract
- **Skills:** Unit Testing, Microsoft Azure, Big Data, Computer Programming, Continuous Integration, Information Engineering, Data Transformation, Python (Programming Language), Query Optimization, Azure Data Lake, SQL Databases, Data Streaming, Parquet, Data Storage Technologies, Azure Data Factory, Git, Modularization, Pytest, Data Lakes, Pyspark, Git Flow, Software Coding, Databricks
- **Published:** September 26, 2026
- **Apply:** https://www.careerjet.com/job/usb93e6dcd716fe16d03fc92a7b4c2f0c6/eaa

## About the Role

Experience: 5-8 years in data engineering with at least 3+ years on Azure.
Azure Data Factory: Pipelines, data flows (mapping/wrangling), triggers, integration runtimes, parameterization, error handling & retries.
Azure Databricks: Databricks Notebooks, Jobs/Workflows, PySpark/Scala, Delta Lake, cluster configuration and Eligible to workimization.
Programming: Advanced Python or Scala (at least one), strong coding standards, modularization, and unit testing (e.g., pytest).
SQL: Expert-level SQL (CTEs, window functions, query tuning), working with large datasets.
Data Storage & Formats: ADLS Gen2, Delta Lake, Parquet, partitioning, Z-Ordering, Eligible to workIMIZE/VACUUM.
Ops & CI/CD: Git, branching strategies, CI/CD for ADF/Databricks; environment promotion; Infrastructure-as-Code exposure is a plus.
Minimum years of experience: 8-10 years



## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [pytest: Simple, rapid and fun testing with Python](https://www.wearedevelopers.com/videos/213-pytest-simple-rapid-and-fun-testing-with-python)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)

## Related Articles

- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Dev Digest 132 - Binging WADFlix?](https://www.wearedevelopers.com/magazine/473-dev-digest-132-binging-wadflix)