> Markdown version of [/jobs/ext/3088627-lead-data-engineer](https://www.wearedevelopers.com/jobs/ext/3088627-lead-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Lead Data Engineer

- **Company:** OPEN QUEUE LLC
- **Location:** Atlanta, GA, United States
- **Experience:** Expert
- **Salary:** $75,000.0 - $100,000.0
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Microsoft Azure, Data Architecture, Data Warehousing, Machine Learning, Systems Integration, Azure Data Factory, Microsoft Fabric, Data Lakes, Pyspark, Databricks
- **Published:** September 26, 2026
- **Apply:** https://www.careerjet.com/jobad/usdfbca52f40b71ac922921aec54b3b229

## About the Role

We are looking for an experienced Lead Azure Data Engineer with strong expertise in designing and architecting enterprise-scale solutions on the Azure Data Platform. The ideal candidate should have hands-on experience with Azure Databricks, ADF, PySpark, data lakes, data warehouses, and modern data architecture., * 5+ years of experience as an Azure Data Engineer.

 * 7+ years of overall experience working on the Azure Data Platform.
 * Design and architect scalable, secure, and highly available Azure data solutions.
 * Strong experience with Azure Databricks and PySpark.
 * Experience integrating multiple data sources with Data Warehouses and Data Lakes.
 * Design and implement data lakes and data warehouses supporting Reporting, AI, and Machine Learning initiatives.
 * Strong understanding of data modeling and data architecture concepts.
 * Knowledge and understanding of Unity Catalog.
 * Knowledge of Azure Cloud Security, governance, and best practices.
 * Understanding of Data Mesh is a plus.
 * Good understanding of Microsoft Fabric and Copilot.
 * Evaluate technology options and clearly communicate their pros and cons.
 * Collaborate with clients to understand business requirements and translate them into technical Azure solutions.
 * Identify and implement automation opportunities to improve operational efficiency.
 * Conduct knowledge-sharing and training sessions for clients and internal teams.
 * Experience with estimation and solution design on Azure Cloud.
 * Life Sciences domain experience - Healthcare, Pharma, Med-Tech, Medical Devices, or Manufacturing - is a plus.



## Related Videos

- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [OLTP in the Lakehouse: Redefining Data for AI Workloads](https://www.wearedevelopers.com/videos/2038-oltp-in-the-lakehouse-redefining-data-for-ai-workloads)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)

## Related Articles

- [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [What Industries Outside of AI Are Hiring The Most AI Experts?](https://www.wearedevelopers.com/magazine/98-what-industries-outside-of-ai-are-hiring-the-most-ai-experts)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)