> Markdown version of [/jobs/ext/4297203-lead-data-engineer](https://www.wearedevelopers.com/jobs/ext/4297203-lead-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Lead Data Engineer

- **Company:** FRACTAL LLC
- **Location:** Fort Thomas, KY, United States
- **Experience:** Expert
- **Salary:** $120,000.0 - $165,000.0
- **Contract:** Permanent contract
- **Skills:** Architectural Patterns, Microsoft Azure, Big Data, Cloud Computing Security, Code Review, Continuous Integration, Information Engineering, Extract Transform Load (ETL), Data Warehousing, Dimensional Modeling, Distributed Data Store, Python (Programming Language), SQL Azure, NumPy, Performance Tuning, Scrum Methodology, Power BI, Standard Sql, SQL Databases, Data Streaming, Systems Integration, Tableau (Software), Data Logging, Scripting, Microsoft Power Automate, Azure Data Factory, Apache Spark, Git, Pandas, Data Lakes, Pyspark, Kubernetes, Apache Kafka, Machine Learning Operations, Azure Synapse Analytics, Data Pipelines, Serverless Computing, Docker, Databricks
- **Published:** October 2, 2026
- **Apply:** https://www.disabledperson.com/jobs/75690326-lead-data-engineer

## About the Role

* 7+ years in data engineering or related fields.
 * 5+ years hands-on with Azure Data Factory building enterprise data pipelines.
 * 5+ years with Databricks, including cluster management, jobs, and performance tuning.
 * Advanced Python proficiency and strong SQL across relational and distributed data systems.
 * Strong experience with Azure Storage (Blob, Data Lake, Table) and hands-on experience with Azure Functions and/or Logic Apps.
 * Proficiency in ETL/ELT design; experience with Git and CI/CD for data engineering.
 * Agile/Scrum experience with strong problem-solving, communication, and documentation skills., * CPG/Retail domain experience.
 * Apache Spark and big-data frameworks; streaming platforms (Azure Event Hubs, Kafka).
 * Data quality and governance frameworks; cloud security, compliance, and best practices.
 * Azure certifications (Azure Data Engineer Associate or higher)
 * MLOps concepts; Docker, Kubernetes, and CI/CD.

Technical Skills:

Azure: Data Factory, Databricks, Storage, Functions, Logic Apps, Azure SQL, Synapse. Languages/Processing: Python, SQL, PySpark, Pandas, NumPy.

Tools & Concepts: Git, Azure DevOps, Power BI/ Tableau, data warehousing, data lakes, dimensional modeling.

## Description

The Lead Data Engineer is responsible for integrating and harmonizing data from multiple internal and external sources to build scalable, enterprise-grade data pipelines on Azure. The role involves collaborating with clients, vendors, and cross-functional teams to understand data sources, define business metrics and KPIs, and develop trusted datasets that support multiple downstream analytics, reporting, and business initiatives. Strong expertise in Azure data services, Python, stakeholder management, and data modelling is essential., * Translate business requirements into technical specifications; evaluate and select optimal tools, technologies, and architectural patterns based on scalability and cost.

 * Lead and coordinate with multiple teams to understand data sources, design the data model and build in the pipelines.
 * Design and develop production-optimized pipelines using Azure Data Factory, Databricks, and other Azure services.
 * Build reusable, modular Python scripts and configure Azure Storage (Blob, Data Lake) with appropriate security and partitioning.
 * Develop serverless, event-driven workflows using Azure Functions and Logic Apps.
 * Implement error handling, logging, monitoring, and testing (unit, integration, performance) to ensure pipeline reliability.
 * Optimize performance by tuning Databricks clusters, ADF activities, and Python code.
 * Document solutions, enforce engineering standards and code reviews, mentor junior engineers, and troubleshoot production pipelines., The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Fractal, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is $120,000 - $165,000 with the potential for a higher base depending on experience, skills, and overall fit for the position. In addition, for the current performance period, you may be eligible for a discretionary bonus.