Senior Data Engineer

TechDigital Corporation
Chicago, IL, United States
1 day ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Working hours
Regular working hours

Tech stack

Cloud Computing Cloud Database Cloud Engineering Databases Continuous Integration Information Engineering Data Governance Extract Transform Load (ETL) Data Migration Data Warehousing DevOps Python (Programming Language)
+16 more
Performance Tuning Systems Development Life Cycle Software Engineering SQL Databases Data Streaming Data Processing Scripting Cloud Platform System Data Ingestion Azure Data Factory Data Lakes Infrastructure Automation Frameworks Data Management Azure Synapse Analytics Data Pipelines Databricks

Job description

The Senior Data Engineer will design, build, and optimize scalable data pipelines and solutions leveraging Databricks, Python, ETL, DevOps. This role requires strong experience in cloud-based data platforms and advanced data engineering practices to support analytics and business intelligence initiatives., * Architect and implement data pipelines using Databricks and Delta Lake for batch and streaming data.

  • Develop and maintain ETL/ELT workflows integrating diverse data sources into cloud data lakes and warehouses.
  • Implement data governance, security, and compliance standards.
  • Automate workflows using Python scripting and CI/CD pipelines.
  • Troubleshoot and resolve issues in data ingestion, transformation, and storage.

Requirements

Business Intelligence, Python Programming/Scripting Language, DevOps, Database Extract Transform and Load (ETL), Data Management, Cloud Computing, Software Engineering, Scalable System Development, Data Warehousing, Regulatory Compliance, * 8+ years in data engineering or related roles.

  • Expert-level Python programming for data processing and automation.
  • Hands-on experience with Databricks and Delta Lake.
  • Strong knowledge of Azure Data Factory, Data Lake, and Synapse (or equivalent cloud platforms).
  • Proficiency in SQL and performance tuning.
  • Familiarity with DevOps practices, CI/CD, and infrastructure-as-code tools.
  • Experience with data migration and cloud-native architectures.
  • Excellent problem-solving and communication skills

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…