Databricks Data Engineer

Motion Recruitment Partners LLC.

Chicago, IL, United States

14 days ago

Apply on www.dice.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

3 years minimum

Working hours

Regular working hours

Job source

www.dice.com

Tech stack

Artificial Intelligence Airflow Amazon Web Services Microsoft Azure Information Engineering Data Infrastructure Extract Transform Load (ETL) Data Warehousing Machine Learning Query Optimization SQL Databases Workflow Management Systems

+12 more

Google Cloud Cloud Platform System Azure Data Factory Apache Spark Event Driven Architecture Microsoft Fabric Pyspark Apache Kafka Terraform Azure Synapse Analytics Data Pipelines Databricks

Job description

Tech Breakdown

50% Databricks / PySpark / Spark
25% Azure Data Platform Services
25% SQL & Data Modeling

Daily Responsibilities

70% Hands On
30% Team Collaboration

Requirements

7+ years of experience in Data Engineering, Data Warehousing, or Data Platform development
3+ years of hands-on Databricks experience in a production environment
Strong expertise with PySpark and Apache Spark
Advanced SQL development and query optimization skills
Experience building ETL/ELT pipelines at enterprise scale
Experience working within Azure, AWS, or Google Cloud Platform cloud environments
Excellent communication skills and ability to partner with technical and business stakeholders

Desired Skills & Experience

Azure Data Factory, Azure Synapse, or Microsoft Fabric experience
Experience with Kafka or event-driven architectures
Databricks Workflows, Airflow, or similar orchestration tools
Infrastructure as Code using Terraform or ARM templates
Experience supporting AI, Machine Learning, or advanced analytics initiatives
Prior experience mentoring engineers or leading technical initiatives

About the company

Join a growing, data-driven organization that is investing heavily in its modern cloud data platform and analytics capabilities. We are seeking a Senior Databricks Data Engineer to design, build, and optimize enterprise-scale data solutions using Databricks, Azure, PySpark, Delta Lake, SQL, and modern cloud technologies. This is a full-time opportunity for an engineer who is passionate about building scalable data products and shaping the future of data architecture.

You’ll have the opportunity to drive architecture decisions, influence engineering standards, and help build a best-in-class Lakehouse platform from the ground up. We’re looking for someone who thrives in complex environments, enjoys solving large-scale data challenges, and wants to work alongside talented engineers who value innovation and continuous learning. If you’re seeking a role that offers technical ownership, career growth, exposure to cutting-edge technologies, and strong work-life balance, this is an opportunity worth exploring.