Lead Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+14 more
Job description
We are seeking a Senior IBM DataStage Developer to support enterprise ETL and data integration workloads. This role is focused on hands-on development, performance tuning, and operational support of DataStage jobs used for analytics, reporting, and operational systems. The position contributes to solution design and best practices while partnering closely with data, QA, and operations teams to ensure stable and scalable data pipelines., * ETL Development & Design
- Design, develop, and maintain IBM DataStage (Parallel Edition) jobs and sequences.
- Build and support data pipelines for analytics, reporting, and downstream operational use cases.
- Apply established ETL design patterns and development standards.
- Assist with data integration design to align with data architecture, security, and governance requirements.
- Perform performance tuning, including partitioning, job parallelism, and batch window optimization.
- Troubleshoot and resolve ETL failures, data issues, and performance problems.
- Support production ETL environments and assist with root-cause analysis for recurring issues.
- Participate in incident response and escalation support for critical batch processes.
- Work with business analysts, data teams, and QA to translate requirements into ETL solutions.
- Participate in code reviews and incorporate feedback to improve quality and maintainability.
- Assist with release activities, deployments, and change management processes.
- Create and maintain technical documentation for jobs, workflows, and operational procedures.
- Use AI tools (such as Claude or Cursor) to assist with code generation and documentation where appropriate.
Requirements
- Bachelor’s degree in Computer Science, Information Systems, Engineering, or equivalent practical experience., * 8+ years of ETL development experience, including 5+ years with IBM DataStage.
- Strong experience with DataStage Parallel Edition (11.7 or CP4D).
- Solid understanding of data warehousing and dimensional modeling concepts.
- Advanced SQL skills with large enterprise databases.
- Proven experience developing and supporting high-volume ETL pipelines.
-
Working knowledge of UNIX/Linux environments and shell scripting.
- Experience with IBM Information Server components (e.g., QualityStage, Metadata Workbench).
- Exposure to cloud or hybrid data platforms (AWS, Azure, or GCP).
-
Familiarity with scheduling, batch processing, and monitoring tools.
- IBM or industry certifications are a plus.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on labcorp.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Top Big Data Technologies That You Need to Know
Data Engineer Salary UK
Data Analyst Salary in the UK
Highest Paying Tech Companies for Developers