Data Engineer (Azure Databricks)- Greenfield Project

duvari group
Maryland Heights, MO, United States
1 day ago
Apply on www.wayup.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$175,000
Working hours
Regular working hours
Job source

Tech stack

Agile Methodology Artificial Intelligence Data Analysis Microsoft Azure Code Review Continuous Integration Information Engineering Data Governance Extract Transform Load (ETL) Data Warehousing Software Debugging DevOps
+17 more
Python (Programming Language) Microsoft Dynamics SQL Azure SAP (Applications) SQL Databases Systems Integration Enterprise Data Management Sql Optimization Retrieval-Augmented Generation Apache Spark Pandas Microsoft Fabric Data Lakes Pyspark Azure Synapse Analytics Workday Databricks

Job description

We are seeking a hands-on Senior Data Engineer to build a greenfield, AI-ready enterprise data platform on Azure. Working alongside Data Architects, you will spend 90%+ of your time developing scalable pipelines in Azure Databricks and Microsoft Fabric to power enterprise reporting, analytics, and GenAI/RAG initiatives. What You’ll Do

  • Build and optimize batch and real-time pipelines in Azure Databricks (90%+ focus) using SQL, Python, PySpark, and Delta Lake, utilizing Microsoft Fabric for ingestion.
  • Implement Lakehouse and medallion architectures, migrating legacy Data Warehouse workloads and integrating ERP/CRM/HR sources (Dynamics 365 F&O/CE, SAP, legacy ERPs, Workday, Entra).
  • Develop dimensional and Lakehouse data models with built-in data quality, lineage, and observability.
  • Support data governance and MDM via Databricks Unity Catalog, Microsoft Purview, and enterprise catalog/MDM platforms.
  • Lead engineering standards, code reviews, CI/CD practices, and mentor onsite/offshore engineers (individual contributor role)., * Employment Type: Contract-to-Hire (strong intent to convert; direct hire considered for exceptional candidates).
  • Team & Process: 4-engineer greenfield team (alongside catalog/MDM engineers). Interview process: Lead Solutions Architect screen followed by hiring manager interview.

Requirements

  • Experience: Minimum 5 years in cloud data engineering (7+ years optimal) and a Bachelor’s degree or equivalent experience.
  • Core Stack: Deep expertise in Azure Databricks (Lakeflow, Spark, Delta) plus hands-on Microsoft Fabric, ADF, Azure Synapse, ADLS, Azure SQL, and Azure DevOps.
  • Code & Modeling: Advanced SQL, expert Python, Spark/Pandas, ETL/ELT, and dimensional/Lakehouse modeling.
  • AI & Modern Data: Experience building AI/ML, GenAI, and RAG-ready datasets, including familiarity with MCP servers, data guidance, and AI-assisted data engineering.
  • Delivery: Strong debugging skills and ability to drive priorities in Agile/DevOps teams. Nice to Have

  • Manufacturing industry experience in complex data environments.
  • Direct integration experience with Dynamics 365 (F&O/CE) or similar ERP/CRM platforms.
  • Familiarity with enterprise data catalogs and MDM platforms.

Benefits & conditions

$175,000 per year

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.wayup.com
Prepare application

Good distractions

Loading talks and stories from around this role…