> Markdown version of [/jobs/ext/2012660-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/2012660-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** Deloitte T.T.L. - **Location:** Hartford, CT, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Airflow, Microsoft Azure, Big Data, Code Review, Information Engineering, Extract Transform Load (ETL), Data Systems, Apache Hive, Python (Programming Language), Microsoft SQL Server, Pair Programming, Azure Data Lake, Cloud Platform System, Azure Data Factory, Cloud Monitoring, Autoscaling, Apache Spark, Git, Data Lakes, Pyspark, Data Management, Terraform, Data Pipelines, Serverless Computing, Key Vault, Databricks - **Published:** August 10, 2026 - **Apply:** https://us.experteer.com/career/view-jobs/senior-data-engineer-hartford-ct-usa-58886153 ## About the Role focusing with client architects and counterparts * Collaborate on data contracts and schema agreements across teams * Design and optimize high-volume data pipelines and implement performance improvements * Define data engineering standards, including naming, partitioning, cluster configurations, and Spark tuning * Develop cluster policies, autoscaling, and cost-optimization strategies * Root cause analysis of production incidents and implement durable fixes * Mentor junior and mid-level engineers through code reviews and pair programming * Evaluate new technologies (e.g., DABs, DLT, Auto Loader, Serverless Compute, event hubs) and recommend adoption Tasks * Python, PySpark, Spark SQL, SQL Server * Azure (ADF, ADLS Gen2, Key Vault, Azure Monitor) * Databricks (Delta Lake, Unity Catalog, Workflows) * Apache Airflow * Git / Azure DevOps * Deep Spark internals (DAG optimization, spill analysis, skew handling) * Delta Lake advanced features (time travel, deletion vectors, predictive I/O) H _ Unity Catalog governance (row/column security, external locations, system tables) * IaC - Terraform, Azure ARM templates * Bachelor's degree in a related IT discipline; or equivalent experience * Limited immigration sponsorship may be available * Ability to travel 10% on average Key requirements * ## Description Experteer Overview In this Senior Data Engineer role, you will shape data solutions within Deloitte's Project Delivery Model, focusing on scalable data pipelines and cloud-based architectures. You will collaborate across cross-functional teams and client interfaces to drive design, governance, and optimization of data platforms. You'll tackle high-volume data challenges, mentor engineers, and evaluate new technologies to keep our data capabilities cutting-edge. This position offers meaningful client work with limited travel and the chance to impact mission-critical data transformations. Compensation / Benefits * Coordinate with Engagement Managers and technical teams to align on issues and escalate where needed * Design, develop and optimize ETL/ELT pipelines using Azure Data Factory and Databricks * Author and tune PySpark / Spark SQL transformations for large-scale data * Architect end-to-end data solutions across development, UAT, and production with Unity Catalog * Lead design discussions with client architects and counterparts * Collaborate on data contracts and schema agreements across teams * Design and optimize high-volume data pipelines and implement performance improvements * Define data engineering standards, including naming, partitioning, cluster configurations, and Spark tuning * Develop cluster policies, autoscaling, and cost-optimization strategies * Root cause analysis of production incidents and implement durable fixes * Mentor junior and mid-level engineers through code reviews and pair programming * Evaluate new technologies (e.g., DABs, DLT, Auto Loader, Serverless Compute, event hubs) and recommend adoption Tasks * Python, PySpark, Spark SQL, SQL Server * Azure (ADF, ADLS Gen2, Key Vault, Azure Monitor) * Databricks (Delta Lake, Unity Catalog, Workflows) * Apache Airflow * Git / Azure DevOps * Deep Spark internals (DAG optimization, spill analysis, skew handling) * Delta Lake advanced features (time travel, deletion vectors, predictive I/O) * Unity Catalog governance (row/column security, external locations, system tables) * IaC - Terraform, Azure ARM templates * Bachelor's degree in a related IT discipline; or equivalent experience * Limited immigration sponsorship may be available * Ability to travel 10% on average Key requirements * ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)