Senior Batch Data Integration Engineer (HPCC/Ecl)

Insight Global

Merion Station, PA, United States

2 months ago

Apply on juju.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

5 years minimum

Compensation

$93,600.0 - $124,800.0

Working hours

Regular working hours

Job source

juju.com

Tech stack

Batch Processing Data Integration Distributed Computing Environment Performance Tuning E2e Testing Data Management Data Delivery

Job description

We are hiring a Senior Batch/Data Integration Engineer to design and implement batch-oriented data delivery solutions within an enterprise data ecosystem. This role focuses on configurable job frameworks, parameterized execution, and consistent file-based delivery across multiple product variants., * Enhance batch processing frameworks to support configurable data inclusion, conditional execution, and parameter-driven output.

Implement and maintain job parameters, control frameworks, and reusable batch components to support multiple downstream consumers.
Design and implement output layout changes, file naming conventions, and delivery schedules in coordination with implementation teams.
Collaborate with upstream and downstream engineering teams to ensure end-to-end integration and data consistency.
Support production readiness, operational validation, and post-deployment stability of batch workloads.

Pay rate: 45-60/hr.

Requirements

5+ years of experience designing and supporting enterprise batch processing systems.
Strong experience with configurable, parameter-driven job execution and large-scale file delivery.

Proven ability to manage dependencies across multiple data platforms and teams.

Experience with Medical Claims Data · Experience working alongside distributed data processing platforms.

Familiarity with operational monitoring, failure recovery, and batch performance tuning.