Data Engineer

Insight Global
Blue Ash, OH, United States
15 days ago
Apply on dejobs.org
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Big Data Data Transformation Data Structures IBM DB2 Microsoft SQL Server Operational Data Store Data Pipelines Databricks

Job description

Seeking experienced Data Engineers to support a large-scale data modernization effort involving legacy transportation and operational data. The team is migrating complex data assets into Azure Databricks while supporting active implementation initiatives and a growing product backlog.

Responsibilities

· Modernize and optimize legacy data views and data pipelines

· Analyze highly complex nested data structures built over many years

· Design, build, and optimize data pipelines within an Azure Databricks Medallion Architecture framework (Bronze, Silver, and Gold layers).

· Work across SQL Server, DB2, and CSV ingestion frameworks

· Partner with Product Managers, Architects, and Technical Leads to understand business context behind requirements

Requirements

· Azure Databricks

· Medallion Architecture

· SQL Server

· Strong problem-solving and analytical skills

Ability to work independently with limited direction · Transportation, logistics, or supply chain data experience

Data modernization and migration experience

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on dejobs.org
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

2:27 min

Managing traffic and tracking costs with Databricks Unity Catalog

Viktoria Semaan Viktoria Semaan · World Congress 2026 Europe

47 sec

Building modern data pipelines for legacy exports

Dr. Alexander Wachtel Dr. Alexander Wachtel +1 · World Congress 2025

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

2:50 min

Executing LoRA fine-tuning using serverless Databricks AI runtimes

Viktoria Semaan Viktoria Semaan · World Congress 2026 Europe

Videos

See all

Related articles

See all