Data Engineer Azure Databricks

BURGEON IT SERVICES LLC
Ann Arbor, MI, United States
9 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours
Job source

Tech stack

Information Engineering Data Governance Extract Transform Load (ETL) Database Queries Distributed Computing Environment Python (Programming Language) Key Management Azure Data Lake Azure Data Factory Gitlab Git Data Lakes
+5 more
Pyspark Restful APIs Software Version Control Databricks Control M

Job description

We are looking for a Senior Data Engineer with strong hands-on experience in Azure Databricks, Azure Data Factory (ADF), and PySpark to design, develop, and maintain enterprise data pipelines.

Requirements

8 10+ years of Data Engineering experience * Strong hands-on experience with Azure Databricks * Strong experience with Azure Data Factory (ADF) * Strong PySpark and Python development experience * Strong SQL skills * Experience with Delta Lake * Experience with Unity Catalog and/or DLT (Delta Live Tables) * Experience with Azure Data Lake Storage (ADLS) * Strong understanding of ETL/ELT and distributed data processing * Experience with Git/GitLab and version control * Ability to work independently in a client-facing onsite environment

Preferred Skills * Databricks REST API * Azure Key Vault / Blob Storage * Data Governance * Control-M

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

6:14 min

Structuring CI/CD pipelines with integrated security and quality checks

Christoph Ruggenthaler · LIVE

1:29 min

Utilizing specific tooling for continuous integration and modeling

Christoph Fassbach Christoph Fassbach +1 · World Congress 2024

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

Videos

See all

Related articles

See all