Data Engineer

Insight Global is hiring a Senior Data Engineer with strong DevOps experience to support Prudential's Chief Data & AI Office. In this role, you will help build and optimize the Enterprise Data Platform (EDP) on AWS, enabling secure, scalable, and reliable access to enterprise data across the organization. You will work closely with architecture and engineering teams to design and implement data solutions using AWS, Informatica, and Ataccama, integrate data from multiple source systems and APIs, and provide recommendations to improve platform performance, scalability, and overall data management capabilities. This role is heavily focused on technology implementation, cloud architecture, and building a modern data ecosystem that supports data accessibility, governance, and reuse across the enterprise.

AWS Solutions Architect or AWS Developer Certification required.

• 8+ years of experience as a Data Engineer building and supporting enterprise data solutions within AWS environments.
• Hands-on expertise with AWS Glue, Lambda, and S3 for developing scalable data ingestion, integration, and processing pipelines.
• Proven experience designing and implementing end-to-end data pipelines and ETL/ELT workflows across complex enterprise environments.
• Expertise building and maintaining cloud-native data platforms that support data ingestion, storage, transformation, integration, and consumption on AWS.
• Experience utilizing AWS CloudFormation to automate infrastructure provisioning and deployment.
• Strong background in DevOps practices, including source control management with GitHub and CI/CD pipeline development using Jenkins.
• Advanced proficiency in Python for developing data pipelines, AWS Glue jobs, Lambda functions, and automation solutions.
• Demonstrated ability to optimize data pipelines, cloud infrastructure, and platform performance to improve scalability, reliability, and efficiency.

Nice to Have Skills & Experience

• Hands-on experience with Informatica Data Catalog, Data Lineage, and Data Marketplace.
• Hands-on experience with Ataccama RDM, MDM, and Data Observability solutions. Knowledge of semantic layer and data virtualization technologies, such as Denodo.

Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.