Sr Databricks Data Engineer

Deloitte T.T.L.
Dallas, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 229K

Job location

Dallas, United States of America

Tech stack

Third Normal Form
Airflow
Amazon Web Services (AWS)
Azure
Cloud Database
Continuous Delivery
Continuous Integration
Data Architecture
Information Engineering
Data Infrastructure
Data Systems
Dimensional Modeling
Machine Learning
Performance Tuning
Cloud Services
Data Streaming
Enterprise Data Management
Google Cloud Platform
Cloud Platform System
Spark
Data Lake
PySpark
Information Technology
Data Management
Data Pipelines
Databricks

Job description

  • Lead the design and implementation of enterprise data pipelines, data models, and cloud-based data architectures using Databricks
  • Build and optimize batch and streaming data solutions that support analytics, reporting, and operational use cases
  • Advise stakeholders on platform capabilities, architecture decisions, governance controls, and delivery approaches aligned to business objectives
  • Drive engineering quality through automation, continuous integration/continuous deployment (CI/CD), performance tuning, and scalable delivery practices
  • Contribute to technical best practices, evaluate emerging platform capabilities, and support teams delivering modern data engineering solutions

The team

Deloitte's Data Engineering teams help organizations build modern, scalable data platforms that support analytics, artificial intelligence, and business transformation. Professionals in this area work across cloud, engineering, and architecture capabilities to design and deliver enterprise data solutions aligned to client and business needs. The team works closely with stakeholders to improve data quality, modernize platforms, and enable insight-driven decision-making.

Requirements

  • Bachelor's degree in Computer Science, Engineering, or a related field and 1+ years of experience leading cross-functional data engineering projects or technical teams
  • 5+ years of experience in data engineering with a focus on Databricks deployed on Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP)
  • 5+ years of experience with Apache Spark, Delta Lake, Lakehouse architecture, and enterprise data warehousing, including third normal form (3NF) and dimensional modeling
  • Experience building batch and incremental data pipelines using PySpark, Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, or Apache Airflow
  • Experience with Databricks Unity Catalog, fine-grained security controls, and continuous integration/continuous deployment (CI/CD) pipeline deployment
  • Ability to travel 50%, on average, based on the work you do and the clients and industries/sectors you serve.
  • Limited immigration sponsorship may be available., * Master's degree in Computer Science, Engineering, or a related field
  • Experience with one or more cloud ecosystems, including Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP)
  • Experience tuning Databricks or Apache Spark workloads for performance and cost efficiency
  • Experience with Databricks Lakeflow
  • Experience supporting artificial intelligence or machine learning use cases on cloud data platforms

Benefits & conditions

The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Deloitte, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is $116,200 to $229,100.

Apply for this position