> Markdown version of [/jobs/ext/2012662-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/2012662-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer

- **Company:** Deloitte T.T.L.
- **Location:** Miami, FL, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Airflow, Microsoft Azure, Big Data, Code Review, Computer Engineering, Data Architecture, Information Engineering, Extract Transform Load (ETL), Data Systems, Apache Hive, Python (Programming Language), Microsoft SQL Server, Pair Programming, Performance Tuning, Azure Data Lake, Azure Service Bus, Azure Data Factory, Cloud Monitoring, Apache Spark, Git, Data Lakes, Pyspark, Information Technology, Data Management, Terraform, Data Pipelines, Serverless Computing, Key Vault, Databricks
- **Published:** August 10, 2026
- **Apply:** https://us.experteer.com/career/view-jobs/senior-data-engineer-miami-fl-usa-58886152

## About the Role

_ data pipelines * Define and enforce data engineering standards (naming, partitioning, cluster configs, Spark tuning) * Drive performance optimization (AQE tuning, liquid clustering, broadcast joins, shuffle partition management) * Design Databricks cluster policies, autoscaling, and cost optimization strategies * Conduct root cause analysis on production incidents and implement permanent fixes * Mentor junior/mid-level engineers via code reviews and pair programming * Evaluate new technologies and recommend adoption (DABs, DLT, Auto Loader, Serverless Compute, event hubs) Tasks * Python * PySpark * Spark SQL * SQL Server * Azure (ADF, ADLS Gen2, Key Vault, Azure Monitor) * Databricks (Delta Lake, Unity Catalog, Workflows) * Apache Airflow * Git / Azure DevOps * Deep Spark internals (DAG optimization, spill analysis, skew handling) * Delta Lake advanced features (time travel, deletion vectors, predictive I/O) * Unity Catalog governance (row/column security, external locations, aaa
ARM tables) * IaC - Terraform, Azure ARM templates * Bachelor's degree in Computer Science, Information Technology, Computer Engineering, or related IT discipline; or equivalent experience * Limited immigration sponsorship may be available * Ability to travel 10% on average Key requirements *

## Description

Experteer Overview Senior Data Engineer at Deloitte to design and optimize data solutions in a collaborative, client-focused setting. You will build end-to-end data pipelines, mentor teammates, and shape data architecture within a cross-functional team. This role emphasizes delivering scalable, production-grade data platforms and driving technology adoption to enable client outcomes. You will work closely with engagement managers and architects to implement robust data engineering standards and performance optimizations. Compensation / Benefits * Design, develop and optimize ETL/ELT pipelines using Azure Data Factory and Databricks * Write and tune PySpark / Spark SQL notebooks for large-scale data transformation * Architect end-to-end data solutions across dev, UAT, prod with Unity Catalog * Lead design discussions with client architects and cross-functional counterparts * Collaborate on data contracts and schema agreements across teams * Lead design and optimization of high-volume data pipelines * Define and enforce data engineering standards (naming, partitioning, cluster configs, Spark tuning) * Drive performance optimization (AQE tuning, liquid clustering, broadcast joins, shuffle partition management) * Design Databricks cluster policies, autoscaling, and cost optimization strategies * Conduct root cause analysis on production incidents and implement permanent fixes * Mentor junior/mid-level engineers via code reviews and pair programming * Evaluate new technologies and recommend adoption (DABs, DLT, Auto Loader, Serverless Compute, event hubs) Tasks * Python * PySpark * Spark SQL * SQL Server * Azure (ADF, ADLS Gen2, Key Vault, Azure Monitor) * Databricks (Delta Lake, Unity Catalog, Workflows) * Apache Airflow * Git / Azure DevOps * Deep Spark internals (DAG optimization, spill analysis, skew handling) * Delta Lake advanced features (time travel, deletion vectors, predictive I/O) * Unity Catalog governance (row/column security, external locations, system tables) * IaC - Terraform, Azure ARM templates * Bachelor's degree in Computer Science, Information Technology, Computer Engineering, or related IT discipline; or equivalent experience * Limited immigration sponsorship may be available * Ability to travel 10% on average Key requirements *


## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)
- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)
- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)