AWS Data Engineer

The Senior AWS Data Engineer will design, build, and optimize cloud-native data platforms and AWS Data Lake solutions supporting enterprise-scale data workloads. This individual will work closely with data engineers, software engineers, architects, and business stakeholders to deliver secure, scalable, and highly available data solutions leveraging AWS native services., * Design, build, and support enterprise-scale AWS Data Lake solutions utilizing Amazon S3, AWS Glue, Athena, Glue Data Catalog, and Lake Formation.

• Design, develop, and optimize scalable ETL/ELT pipelines using AWS Glue, Lambda, Step Functions, EMR, PySpark, and related AWS services.
• Design and support cloud-native data lake and data warehouse architectures for enterprise analytics and reporting.
• Engineer, administer, and optimize Aurora MySQL and AWS RDS database environments, including performance tuning, backup and recovery, replication, monitoring, and SQL optimization.
• Develop Python-based automation for data ingestion, transformation, monitoring, and operational support.
• Build and maintain Infrastructure-as-Code deployments using Terraform and/or CloudFormation.
• Develop and support Git-based CI/CD pipelines for AWS data platform deployments.
• Implement data governance, metadata management, lineage, cataloging, and security controls using AWS Glue Data Catalog, Lake Formation, and related AWS services.
• Collaborate with architects and engineering teams to define scalable data models, ingestion patterns, and cloud data platform best practices.
• Monitor production environments, troubleshoot complex issues, and drive continuous improvements in automation, performance, scalability, and reliability.
• Participate throughout the SDLC including design, development, testing, deployment, and production support.
• Participate in scheduled after-hours deployments and production support as required.
• Ensure compliance with enterprise security, governance, and cloud operational standards.

• 5+ years of hands-on AWS Data Engineering experience building enterprise cloud-native data platforms.
• Strong hands-on experience designing, building, and supporting AWS Data Lake solutions utilizing Amazon S3, AWS Glue, Athena, Glue Data Catalog, and Lake Formation.
• Strong experience developing ETL/ELT pipelines using AWS Glue, Lambda, Step Functions, EMR, PySpark, and related AWS technologies.
• Strong Aurora MySQL and/or AWS RDS MySQL database engineering experience, including performance tuning, backup/recovery, replication, monitoring, and SQL optimization.
• Strong proficiency in Python and SQL for data engineering, automation, and complex data transformations.
• Experience designing cloud-native data lake and data warehouse architectures.
• Experience implementing Infrastructure-as-Code using Terraform and/or CloudFormation.
• Experience developing and supporting Git-based CI/CD pipelines.
• Experience implementing data governance, metadata management, lineage, and cataloging using AWS-native services.
• Strong understanding of AWS Cloud architecture, security, IAM, monitoring, and automation best practices.
• Excellent analytical, troubleshooting, collaboration, and communication skills.

Preferred Skills

• Financial services industry experience.
• Experience with Amazon Redshift or other enterprise data warehouse technologies.
• Experience with SageMaker or machine learning data pipelines.
• AWS Certifications (Data Analytics Specialty, Solutions Architect Associate/Professional, or equivalent).

Software Guidance & Assistance, Inc. (SGA) is searching for a Senior AWS Data Engineer for a C ontract assignment with one of our premier Financial Services clients located in Midtown, NYC. This role follows a hybrid schedule requiring 2 days onsite and 3 days remote., SGA is a technology and resource solutions provider driven to stand out. We are a women-owned business. Our mission: to solve big IT problems with a more personal, boutique approach. Each year, we match consultants like you to more than 1,000 engagements. When we say let’s work better together, we mean it. You’ll join a diverse team built on these core values: customer service, employee development, and quality and integrity in everything we do. Be yourself, love what you do and find your passion at work. Please find us at .