Data Engineer (Azure Databricks)- Greenfield Project
duvari group
Maryland Heights, MO, United States
1 day ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.wayup.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$175,000
Working hours
Regular working hours
Job source
Tech stack
Agile Methodology
Artificial Intelligence
Data Analysis
Microsoft Azure
Code Review
Continuous Integration
Information Engineering
Data Governance
Extract Transform Load (ETL)
Data Warehousing
Software Debugging
DevOps
+17 more
Python (Programming Language)
Microsoft Dynamics
SQL Azure
SAP (Applications)
SQL Databases
Systems Integration
Enterprise Data Management
Sql Optimization
Retrieval-Augmented Generation
Apache Spark
Pandas
Microsoft Fabric
Data Lakes
Pyspark
Azure Synapse Analytics
Workday
Databricks
Job description
We are seeking a hands-on Senior Data Engineer to build a greenfield, AI-ready enterprise data platform on Azure. Working alongside Data Architects, you will spend 90%+ of your time developing scalable pipelines in Azure Databricks and Microsoft Fabric to power enterprise reporting, analytics, and GenAI/RAG initiatives. What Youβll Do
- Build and optimize batch and real-time pipelines in Azure Databricks (90%+ focus) using SQL, Python, PySpark, and Delta Lake, utilizing Microsoft Fabric for ingestion.
- Implement Lakehouse and medallion architectures, migrating legacy Data Warehouse workloads and integrating ERP/CRM/HR sources (Dynamics 365 F&O/CE, SAP, legacy ERPs, Workday, Entra).
- Develop dimensional and Lakehouse data models with built-in data quality, lineage, and observability.
- Support data governance and MDM via Databricks Unity Catalog, Microsoft Purview, and enterprise catalog/MDM platforms.
- Lead engineering standards, code reviews, CI/CD practices, and mentor onsite/offshore engineers (individual contributor role)., * Employment Type: Contract-to-Hire (strong intent to convert; direct hire considered for exceptional candidates).
- Team & Process: 4-engineer greenfield team (alongside catalog/MDM engineers). Interview process: Lead Solutions Architect screen followed by hiring manager interview.
Requirements
- Experience: Minimum 5 years in cloud data engineering (7+ years optimal) and a Bachelorβs degree or equivalent experience.
- Core Stack: Deep expertise in Azure Databricks (Lakeflow, Spark, Delta) plus hands-on Microsoft Fabric, ADF, Azure Synapse, ADLS, Azure SQL, and Azure DevOps.
- Code & Modeling: Advanced SQL, expert Python, Spark/Pandas, ETL/ELT, and dimensional/Lakehouse modeling.
- AI & Modern Data: Experience building AI/ML, GenAI, and RAG-ready datasets, including familiarity with MCP servers, data guidance, and AI-assisted data engineering.
-
Delivery: Strong debugging skills and ability to drive priorities in Agile/DevOps teams. Nice to Have
- Manufacturing industry experience in complex data environments.
- Direct integration experience with Dynamics 365 (F&O/CE) or similar ERP/CRM platforms.
- Familiarity with enterprise data catalogs and MDM platforms.
Benefits & conditions
$175,000 per year
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.wayup.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦