Informatica to AWS Glue Migration Specialist

Metanlytics Llc
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate

Job location

Remote

Tech stack

Airflow
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Continuous Integration
Data Validation
Data Governance
Data Integration
ETL
Data Warehousing
Relational Databases
Database Queries
Dimensional Modeling
Distributed Computing Environment
Amazon DynamoDB
Identity and Access Management
Python
PostgreSQL
Metadata Repositories
Microsoft SQL Server
MySQL
Oracle Applications
Scrum
SQL Databases
Informatica Powercenter
Snowflake
Spark
AWS Lambda
GIT
Amazon Web Services (AWS)
PySpark
Amazon Web Services (AWS)
Data Analytics
Amazon Web Services (AWS)
Data Management
Cloud Migration
Functional Programming
Cloudwatch
Software Version Control
Redshift
Databricks

Job description

We are seeking an experienced Informatica to AWS Glue Migration Specialist to lead and support the migration of enterprise ETL workloads from Informatica PowerCenter to AWS Glue. The ideal candidate will have strong expertise in ETL development, data integration, cloud migration strategies, and AWS data services. The role involves analyzing existing Informatica workflows, redesigning and implementing them in AWS Glue, and ensuring performance, scalability, and data quality throughout the migration process., Assess and analyze existing Informatica PowerCenter mappings, workflows, sessions, and ETL processes. Design migration strategies and roadmaps for converting Informatica workloads to AWS Glue. Develop and implement AWS Glue Jobs using PySpark and Python. Migrate ETL pipelines, transformations, and data integration processes from Informatica to AWS Glue. Configure and manage AWS Glue Crawlers, Data Catalogs, and Workflows. Integrate AWS Glue with Amazon S3, Redshift, RDS, Aurora, DynamoDB, and other AWS services. Perform data validation, reconciliation, and testing to ensure migration accuracy. Optimize AWS Glue jobs for performance, scalability, and cost efficiency. Troubleshoot migration issues and provide production support. Collaborate with data architects, business analysts, and application teams throughout the migration lifecycle. Create technical documentation, migration runbooks, and knowledge transfer materials. Implement security and governance best practices within the AWS environment., AWS Glue PySpark Python SQL Amazon S3 Amazon Redshift AWS Lambda AWS Athena AWS IAM AWS CloudWatch Git Jenkins / CI-CD Data Warehousing ETL/ELT Development Nice to Have Experience with Snowflake migrations.

Requirements

5+ years of ETL/Data Integration experience. 3+ years of hands-on experience with AWS Glue. Strong experience with Informatica PowerCenter development and administration. Expertise in Python and PySpark development. Experience with AWS services including S3, IAM, Lambda, CloudWatch, Redshift, RDS, and Athena. Strong SQL skills and experience with relational databases such as Oracle, SQL Server, PostgreSQL, or MySQL. Experience migrating large-scale enterprise ETL environments to cloud platforms. Understanding of data warehousing concepts and dimensional modeling. Experience with CI/CD pipelines and version control systems such as Git. Excellent problem-solving and communication skills. Preferred Qualifications AWS Certified Data Analytics - Specialty or AWS Certified Solutions Architect. Experience with AWS Lake Formation. Experience with Apache Spark and distributed data processing. Knowledge of Data Quality, Master Data Management (MDM), and Data Governance practices. Experience with Agile/Scrum methodologies. Technical Skills, Experience with Databricks. Experience with Airflow or AWS Step Functions. Knowledge of healthcare, banking, or financial services data platforms.

Apply for this position