Data Engineer

Insight Global
Warren, MI, United States
2 days ago
Apply on dejobs.org
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Big Data Data Governance Data Integration Extract Transform Load (ETL) Data Security Python (Programming Language) Cloud Services SQL Databases Data Streaming Systems Integration Azure Data Factory
+5 more
Apache Spark Deployment Automation Apache Kafka Data Pipelines Databricks

Job description

Design, develop, and maintain reliable data pipelines and integration services that support the MIE applications. Establish data quality controls, enable governed data access, and help build the platform capabilities required for scalable analytics and AI/ML use cases.

Requirements

3+ years of experience as a data engineer Experience designing ETL pipelines and using databricks Experience with Python, SQL, Databricks, Azure Data Factory, or Apache Spark; data integration and orchestration; relational and cloud data platforms; streaming or messaging tools such as Kafka; data quality frameworks; and infrastructure or deployment automation.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on dejobs.org
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

5:14 min

Executing Databricks jobs with built-in Airflow operators

Alan Mazankiewicz · LIVE

5:43 min

Processing real-time event streams with Apache Kafka

Alex Soto Alex Soto · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:38 min

Overview of Databricks and interactive data processing

Alan Mazankiewicz · LIVE

1:41 min

Visualizing the complex developer journey for JVM ecosystems

Bobur Umurzokov · LIVE

Videos

See all

Related articles

See all