Azure Databricks Data Engineer
Databricks
Warren, MI, United States
2 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
4 years minimum
Compensation
$104,000.0
Working hours
Regular working hours
Job source
Tech stack
Artificial Intelligence
Data Analysis
Microsoft Azure
Big Data
Cloud Computing
Continuous Integration
Data Architecture
Information Engineering
Extract Transform Load (ETL)
Data Systems
Data Warehousing
Github
+19 more
Python (Programming Language)
Power BI
Standard Sql
Data Streaming
Unstructured Data
Azure Data Factory
Retrieval-Augmented Generation
Snowflake
Apache Spark
Generative AI
Microsoft Fabric
Data Lakes
Pyspark
Infrastructure Automation Frameworks
Collibra
Apache Kafka
Terraform
Data Pipelines
Databricks
Job description
- Design and maintain scalable data pipelines using Azure Databricks and Spark.
- Develop and optimize ETL/ELT workflows for large-scale datasets.
- Build and manage Lakehouse-based data solutions.
- Implement data quality, governance, and security best practices.
- Optimize Spark workloads for performance and cost efficiency.
- Integrate structured and unstructured data from multiple sources.
- Support CI/CD processes and infrastructure automation.
- Collaborate with Analytics, BI, AI/ML, and business teams.
Preferred Skills
- Unity Catalog
- Azure DevOps / GitHub Actions
- Terraform
- Kafka / Azure Event Hubs
- Snowflake
- Power BI
- Microsoft Fabric
- Azure Purview
- Generative AI and RAG architecture exposure
Requirements
- 5+ years of Data Engineering experience
- 5+ years of Azure Data Engineering experience
- 4+ years of hands-on Azure Databricks experience
- Strong experience with Apache Spark / PySpark
- Expertise in Python and SQL
- Experience building ETL/ELT pipelines
- Strong knowledge of Delta Lake and Lakehouse architecture
- Experience with Data Modeling and Data Warehousing
- Cloud experience in Azure (preferred)
About the company
We are seeking an experienced Azure Databricks Data Engineer to design, develop, and optimize enterprise-scale data solutions on the Databricks Lakehouse Platform. The ideal candidate will have strong expertise in Azure Data Engineering, Databricks, Spark/PySpark, Delta Lake, and modern cloud-based data architectures.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦