AnInitio ETL Data Engineer

We are seeking an experienced ETL / Data Engineering Developer to design, develop, and maintain data pipelines and ETL processes. The ideal candidate will have hands-on experience with data movement, transformation, data cleansing, and Ab Initio. The role involves preparing production data for QA environments and ensuring data quality, accuracy, and reliability. Key Responsibilities Develop, maintain, and optimize ETL pipelines for data extraction, transformation, and loading. Manage data movement and transformation across multiple systems and environments. Scrub, cleanse, and prepare production data for use in QA and testing environments. Develop and support data processing workflows using Ab Initio. Ensure data quality, integrity, consistency, and reliability throughout ETL processes. Troubleshoot data pipeline issues and optimize performance. Collaborate with development, QA, and data teams to support data integration and testing requirements. Follow data security, governance, and best practices when handling production data.

ETL pipeline development Ab Initio - Must Have Preferred Skills

• Spark
• Scala
• Python
• AWS
• Data processing frameworks, Hands-on experience in ETL development and data engineering. Strong understanding of data movement, transformation, and data cleansing processes. Experience with Ab Initio and ETL pipeline development. Understanding of data integration, data quality, and processing workflows. Preferred Skills Experience with Apache Spark and Scala. Programming experience in Python. Familiarity with AWS data services and cloud-based data processing. Knowledge of distributed computing and data processing frameworks. Experience troubleshooting and optimizing large-scale data pipelines.