> Markdown version of [/jobs/ext/2015034-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/2015034-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer

- **Company:** Deloitte T.T.L.
- **Location:** Houston, TX, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Airflow, Microsoft Azure, Code Review, Computer Engineering, Information Engineering, Extract Transform Load (ETL), Data Security, Data Systems, Apache Hive, Python (Programming Language), Microsoft SQL Server, Performance Tuning, Azure Data Lake, Azure Service Bus, Azure Data Factory, Cloud Monitoring, Apache Spark, Git, Data Lakes, Pyspark, Information Technology, Terraform, Data Pipelines, Serverless Computing, Key Vault, Databricks
- **Published:** August 10, 2026
- **Apply:** https://us.experteer.com/career/view-jobs/senior-data-engineer-houston-tx-usa-58886150

## About the Role

standards * Lead design and optimization of high-volume data pipelines * Define and enforce data engineering standards and configuration best practices * Drive performance optimization, including AQE tuning and partition management * Design Databricks cluster policies and cost optimization strategies * Investigate production incidents and implement fixes * Mentor junior/mid-level engineers through code reviews and pairing * Evaluate new technologies and recommend adoption (e.g., DABs, DLT, Auto Loader, Serverless Compute, event hubs) Tasks * Python, PySpark, Spark SQL, SQL Server * Azure (ADF, ADLS Gen2, Key Vault, Azure Monitor) * Databricks (Delta Lake, Unity Catalog, Workflows) * Apache Airflow * Git / Azure DevOps * Deep Spark internals (DAG optimization, spill analysis, skew handling) * Delta Lake advanced features (time travel, deletion vectors, predictive I/O) * Unity Catalog governance (row/column security, external locations, system tables) * IaC - Terraform, Azure ARM aaa
(e.g., * Bachelor's degree in Computer Science, Information Technology, Computer Engineering, or related IT discipline; or equivalent experience * Limited immigration sponsorship may be available * Ability to travel 10% on average Key requirements *

## Description

Experteer Overview As a Senior Data Engineer, you will design and optimize data pipelines and platforms for enterprise clients within Deloitte's Project Delivery Model. You will collaborate with cross-functional teams, architect end-to-end data solutions, and mentor junior engineers. You'll work with cutting-edge technologies to drive scalable, secure data environments and improve production reliability. This role offers hands-on technical impact with a focus on collaboration and client delivery in a consulting context. Compensation / Benefits * Coordinate with Engagement Managers and cross-functional teams, escalating issues as needed * Design, develop, and optimize ETL/ELT pipelines using Azure Data Factory and Databricks * Develop PySpark / Spark SQL notebooks for large-scale transformations * Architect end-to-end data solutions across dev, UAT, prod with Unity Catalog * Lead design discussions with client architects and counterparts * Collaborate on data contracts and schema agreements * Lead design and optimization of high-volume data pipelines * Define and enforce data engineering standards and configuration best practices * Drive performance optimization, including AQE tuning and partition management * Design Databricks cluster policies and cost optimization strategies * Investigate production incidents and implement fixes * Mentor junior/mid-level engineers through code reviews and pairing * Evaluate new technologies and recommend adoption (e.g., DABs, DLT, Auto Loader, Serverless Compute, event hubs) Tasks * Python, PySpark, Spark SQL, SQL Server * Azure (ADF, ADLS Gen2, Key Vault, Azure Monitor) * Databricks (Delta Lake, Unity Catalog, Workflows) * Apache Airflow * Git / Azure DevOps * Deep Spark internals (DAG optimization, spill analysis, skew handling) * Delta Lake advanced features (time travel, deletion vectors, predictive I/O) * Unity Catalog governance (row/column security, external locations, system tables) * IaC - Terraform, Azure ARM templates * Bachelor's degree in Computer Science, Information Technology, Computer Engineering, or related IT discipline; or equivalent experience * Limited immigration sponsorship may be available * Ability to travel 10% on average Key requirements *


## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)
- [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)