Sr Databricks Data Engineer
Role details
Job location
Tech stack
Job description
- Lead the design and implementation of enterprise data pipelines, data models, and cloud-based data architectures using Databricks
- Build and optimize batch and streaming data solutions that support analytics, reporting, and operational use cases
- Advise stakeholders on platform capabilities, architecture decisions, governance controls, and delivery approaches aligned to business objectives
- Drive engineering quality through automation, continuous integration/continuous deployment (CI/CD), performance tuning, and scalable delivery practices
- Contribute to technical best practices, evaluate emerging platform capabilities, and support teams delivering modern data engineering solutions
The team
Deloitte's Data Engineering teams help organizations build modern, scalable data platforms that support analytics, artificial intelligence, and business transformation. Professionals in this area work across cloud, engineering, and architecture capabilities to design and deliver enterprise data solutions aligned to client and business needs. The team works closely with stakeholders to improve data quality, modernize platforms, and enable insight-driven decision-making.
Requirements
- Bachelor's degree in Computer Science, Engineering, or a related field and 1+ years of experience leading cross-functional data engineering projects or technical teams
- 5+ years of experience in data engineering with a focus on Databricks deployed on Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP)
- 5+ years of experience with Apache Spark, Delta Lake, Lakehouse architecture, and enterprise data warehousing, including third normal form (3NF) and dimensional modeling
- Experience building batch and incremental data pipelines using PySpark, Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, or Apache Airflow
- Experience with Databricks Unity Catalog, fine-grained security controls, and continuous integration/continuous deployment (CI/CD) pipeline deployment
- Ability to travel 50%, on average, based on the work you do and the clients and industries/sectors you serve.
- Limited immigration sponsorship may be available., * Master's degree in Computer Science, Engineering, or a related field
- Experience with one or more cloud ecosystems, including Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP)
- Experience tuning Databricks or Apache Spark workloads for performance and cost efficiency
- Experience with Databricks Lakeflow
- Experience supporting artificial intelligence or machine learning use cases on cloud data platforms
Benefits & conditions
The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Deloitte, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is $116,200 to $229,100.