> Markdown version of [/jobs/ext/2016143-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/2016143-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer

- **Company:** Deloitte T.T.L.
- **Location:** Jersey City, NJ, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Airflow, Microsoft Azure, Big Data, Code Review, Information Engineering, Extract Transform Load (ETL), Data Systems, Apache Hive, Python (Programming Language), Microsoft SQL Server, Pair Programming, Performance Tuning, Azure Data Lake, Azure Service Bus, Azure Data Factory, Cloud Monitoring, Apache Spark, Git, Data Lakes, Pyspark, Information Technology, Data Management, Terraform, Data Pipelines, Serverless Computing, Key Vault, Databricks
- **Published:** August 10, 2026
- **Apply:** https://us.experteer.com/career/view-jobs/senior-data-engineer-jersey-city-nj-usa-58886158

## About the Role

and and optimization of high-volume data pipeline * Define and enforce data engineering standards - naming conventions, partitioning strategies, cluster configurations, Spark tuning * Drive performance optimization - AQE tuning, liquid clustering, broadcast joins, shuffle partition management * Design Databricks cluster policies, autoscaling configurations, and cost optimization strategies * Conduct root cause analysis on production incidents and implement permanent fixes * Mentor junior and mid-level engineers through code reviews and pair programming * Evaluate new technologies and recommend adoption (e.g., DABs, DLT, Auto Loader, Serverless Compute, event hubs) Tasks * Python, PySpark, Spark SQL, SQL Server * Azure (ADF, ADLS Gen2, Key Vault, Azure Monitor) * Databricks (Delta Lake, Unity Catalog, Workflows) * Apache Airflow * Git / Azure DevOps * Deep Spark internals (DAG optimization, spill analysis, skew handling) * Delta Lake advanced features (time travel, deletion vectors, a
implement I/O) * Unity Catalog governance (row/column security, external locations, system tables) * IaC - Terraform, Azure ARM templates * Bachelor's degree in Computer Science or related IT discipline; or equivalent experience Key requirements *

## Description

Experteer Overview As a Senior Data Engineer at Deloitte, you will design and implement end-to-end data solutions that enable client decisions at scale. You'll collaborate with engagement managers and cross-functional teams to deliver robust ETL/ELT pipelines, governance, and performance optimizations in Azure Databricks environments. You'll mentor engineers, drive design discussions, and evaluate new technologies to modernize clients' data platforms. This role offers hands-on impact with minimal travel under the Project Delivery Model. Compensation / Benefits * Design, develop and optimize ETL/ELT pipelines using Azure Data Factory and Databricks * Write and tune PySpark / Spark SQL notebooks for large-scale data transformation * Architect end-to-end data solutions across dev UAT prod environments using Unity Catalog * Lead and drive design discussions with client architects and other counterparts * Collaborate with different teams on data contracts and schema agreements * Lead design and optimization of high-volume data pipeline * Define and enforce data engineering standards - naming conventions, partitioning strategies, cluster configurations, Spark tuning * Drive performance optimization - AQE tuning, liquid clustering, broadcast joins, shuffle partition management * Design Databricks cluster policies, autoscaling configurations, and cost optimization strategies * Conduct root cause analysis on production incidents and implement permanent fixes * Mentor junior and mid-level engineers through code reviews and pair programming * Evaluate new technologies and recommend adoption (e.g., DABs, DLT, Auto Loader, Serverless Compute, event hubs) Tasks * Python, PySpark, Spark SQL, SQL Server * Azure (ADF, ADLS Gen2, Key Vault, Azure Monitor) * Databricks (Delta Lake, Unity Catalog, Workflows) * Apache Airflow * Git / Azure DevOps * Deep Spark internals (DAG optimization, spill analysis, skew handling) * Delta Lake advanced features (time travel, deletion vectors, predictive I/O) * Unity Catalog governance (row/column security, external locations, system tables) * IaC - Terraform, Azure ARM templates * Bachelor's degree in Computer Science or related IT discipline; or equivalent experience Key requirements *


## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)

## Related Articles

- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)