Senior Data Engineer (Azure Databricks)

Finoit Inc
Chicago, IL, United States
10 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
6 years minimum
Compensation
$148,000.0 - $164,000.0
Working hours
Regular working hours
Job source

Tech stack

Microsoft Azure Cloud Engineering Data as a Services Data Architecture Information Engineering Data Systems Software Debugging Python (Programming Language) Metadata Performance Tuning Cloud Services SQL Databases
+7 more
Data Processing Data Ingestion Azure Data Factory Software Troubleshooting Information Technology Data Pipelines Databricks

Job description

We are seeking a highly skilled Senior Data Engineer to join a growing data engineering team. The ideal candidate will have strong experience designing, building, and maintaining scalable end-to-end data pipelines in modern cloud environments, with expertise in Azure Databricks., * Design, develop, and maintain scalable end-to-end data pipelines.

  • Build data ingestion, validation, transformation, and governance frameworks.
  • Develop reusable, metadata-driven data pipeline solutions.
  • Optimize data processing performance and troubleshoot complex data issues.
  • Design and implement scalable data architecture to support business needs.
  • Collaborate with cross-functional teams to deliver reliable data solutions.
  • Implement data quality, monitoring, and testing best practices.
  • Work with cloud-native data platforms and services to support enterprise analytics.

Requirements

  • Bachelor’s degree in Computer Science, Engineering, Data Science, or a related field.
  • 6+ years of hands-on experience building and owning end-to-end data pipelines.
  • Expert-level proficiency in Python and SQL.
  • Strong experience with data ingestion, transformation, validation, and governance.
  • Ability to design scalable data architectures and clearly communicate technical solutions.
  • Experience building reusable, metadata-driven pipelines.
  • Strong troubleshooting, debugging, and performance optimization skills.
  • Hands-on experience with data modeling, testing, monitoring, and data quality practices.

Preferred Qualifications

  • Strong experience with Azure Databricks (required/preferred platform).
  • Experience with Azure Data Factory and other Azure cloud data services.
  • Familiarity with enterprise data engineering best practices and cloud-native architectures.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:47 min

Comparing Egeria to alternative open metadata solutions

Ferd Scheepers · World Congress 2022

2:27 min

Managing traffic and tracking costs with Databricks Unity Catalog

Viktoria Semaan Viktoria Semaan · World Congress 2026 Europe

2:37 min

Classifying and anonymizing data during system design

Reto Kaeser · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:08 min

Creating standard APIs via the Egeria open metadata project

Ferd Scheepers · World Congress 2022

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

Videos

See all

Related articles

See all