Data Engineer

DTEL Engineering & Consultants Inc

Chicago, IL, United States

26 days ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Working hours

Regular working hours

Job source

www.dice.com

Tech stack

Microsoft Azure Code Review Extract Transform Load (ETL) Distributed Computing Environment Python (Programming Language) SQL Azure Performance Tuning Azure Data Lake SQL Databases Pulumi Azure Data Factory Sql Optimization

+8 more

Build Management Data Lakes Pyspark Google Cloud Functions Data Pipelines Api Management Azure Resource Manager Databricks

Job description

PySpark (distributed processing, optimization)
Azure Data Factory (pipelines, triggers, monitoring)
Databricks (Delta Lake, workflows, clusters)
Azure (ADLS Gen2, Azure SQL, Resource Groups, Portal)
Pulumi (Infrastructure as Code)
Azure API Services
Azure Function Apps

Roles & Responsibilities

Design and build end-to-end data pipelines
Develop and optimize SQL and PySpark transformations
Build production-grade Python components
Create and maintain ADF pipelines
Work within Azure environments
Provision Azure resources using Pulumi
Participate in code reviews, documentation, and operational support

Requirements

Must Have Technical/Functional Skills

ETL/ELT concepts (pipelines, incremental loads, validation)
Advanced SQL (CTEs, joins, performance tuning)

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

Moments

Explore playlists

2:57 min

Core technical practices for robust data engineering

Sandhya Menon · WWC Europe 2026

2:11 min

Evaluating application design patterns in microservices

Paweł Siwek · WWC 2025

1:55 min

Contrasting Terraform with Pulumi and cloud-specific tools

Devlin Duldulao · LIVE

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

1:53 min

Selecting appropriate container orchestration and data storage

Paweł Siwek · WWC 2025

3:20 min

Overview of infrastructure as code tools

Alexander Bubeck · WWC 2023

Videos

See all

PySpark - Combining Machine Learning & Big Data thumbnail