Data Engineer
DTEL Engineering & Consultants Inc
Chicago, IL, United States
3 months ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source
Tech stack
Microsoft Azure
Code Review
Extract Transform Load (ETL)
Distributed Computing Environment
Python (Programming Language)
SQL Azure
Performance Tuning
Azure Data Lake
SQL Databases
Pulumi
Azure Data Factory
Sql Optimization
+8 more
Build Management
Data Lakes
Pyspark
Google Cloud Functions
Data Pipelines
Api Management
Azure Resource Manager
Databricks
Job description
- PySpark (distributed processing, optimization)
- Azure Data Factory (pipelines, triggers, monitoring)
- Databricks (Delta Lake, workflows, clusters)
- Azure (ADLS Gen2, Azure SQL, Resource Groups, Portal)
- Pulumi (Infrastructure as Code)
- Azure API Services
- Azure Function Apps
Roles & Responsibilities
- Design and build end-to-end data pipelines
- Develop and optimize SQL and PySpark transformations
- Build production-grade Python components
- Create and maintain ADF pipelines
- Work within Azure environments
- Provision Azure resources using Pulumi
- Participate in code reviews, documentation, and operational support
Requirements
Must Have Technical/Functional Skills
- ETL/ELT concepts (pipelines, incremental loads, validation)
- Advanced SQL (CTEs, joins, performance tuning)
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦