> Markdown version of [/jobs/ext/1426239-etl-lead-datastage-cp4d-aws-glue](https://www.wearedevelopers.com/jobs/ext/1426239-etl-lead-datastage-cp4d-aws-glue). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# ETL Lead - DataStage CP4D | AWS Glue

- **Company:** IntraEdge, Inc.
- **Location:** Detroit, MI, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Amazon Web Services, Amazon S3, Data Analysis, Big Data, Cloud Computing, Code Review, Continuous Integration, Data Governance, Extract Transform Load (ETL), Data Transformation, Data Warehousing, IBM InfoSphere DataStage, Python (Programming Language), Meta-Data Management, Performance Tuning, Scrum Methodology, Standard Sql, User-Centered Design, Delivery Pipeline, Snowflake, Parallel Computation, AWS Lambda, Git, Pyspark, Semi-structured Data, Data Lineage, Collibra, AWS Glue, Data Analytics, Software Version Control, Serverless Computing, Jenkins
- **Published:** July 24, 2026
- **Apply:** https://jobs.intraedge.com/jobdetails.asp?jo_num=20425&apply=yes&

## About the Role

* 8+ years of enterprise data integration experience with at least 3+ years as a technical lead.
 * Strong expertise in IBM DataStage, including modern deployments on Cloud Pak for Data (CP4D).
 * Solid experience with AWS Glue (PySpark) and AWS Lambda for scalable, serverless data transformation.
 * Proven knowledge of Snowflake data warehousing, including external stages, streams, tasks, and performance tuning.
 * Experience with complex ETL orchestration involving parallel processing, dynamic parameterization, and error handling.
 * Strong SQL, Python (preferred for Glue), and performance tuning skills.
 * Understanding of data lakehouse architectures, S3, and ingestion patterns (batch/real-time).
 * Familiarity with data governance and lineage tools (e.g., Collibra, BigID, Manta).
 * Knowledge of CI/CD, Git, Jenkins, and code promotion strategies.
 * Strong verbal and written communication skills; experience working in agile/scrum delivery model.

Preferred Qualifications

 * IBM DataStage CP4D certification
 * AWS Certified Data Analytics or Solutions Architect - Associate
 * Snowflake SnowPro certification
 * Experience working in regulated industries (e.g., financial services, utilities, healthcare)

## Description

We are seeking a highly experienced ETL Lead to design, lead, and optimize enterprise data integration workflows using IBM DataStage on Cloud Pak for Data (CP4D), AWS Glue & Lambda, and Snowflake. The ideal candidate will drive modern data transformation strategies for large-scale data ingestion pipelines supporting analytics, governance, and AI/ML workloads., * Lead the end-to-end design and implementation of ETL workflows for structured and semi-structured data from various sources (SFTP, DB2, Oracle, APIs).

 * Architect and maintain data ingestion and transformation pipelines using IBM DataStage (CP4D) and AWS Glue/Lambda functions.
 * Optimize data load performance and manage large data volumes with effective partitioning, incremental loads, and error handling.
 * Collaborate with cloud engineers and data modelers to ensure data is curated for consumption in Snowflake (Silver/Gold/Platinum layers).
 * Ensure data lineage, metadata management, and data quality in compliance with enterprise data governance standards.
 * Partner with governance teams to ensure integration with Collibra, or other metadata and privacy tools.
 * Support CI/CD integration, parameterization, and version control of ETL code via Git and DevOps pipelines.
 * Lead and mentor a team of onshore/offshore ETL developers; establish best practices and code review processes.
 * Troubleshoot production ETL issues and participate in on-call rotations as needed.


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [The Road to MLOps: How Verivox Transitioned to AWS](https://www.wearedevelopers.com/videos/1050-the-road-to-mlops-how-verivox-transitioned-to-aws)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)

## Related Articles

- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [From Prototype to Production: Build AI Agents with This Free 4-Course Learning Path](https://www.wearedevelopers.com/magazine/655-from-prototype-to-production-build-ai-agents-with-this-free-4-course-learning-path)
- [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence)