Lead AWS Data Engineer

Centraprise LLC

Jersey City, NJ, United States

18 days ago

Apply on www.careerjet.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

9 years minimum

Working hours

Regular working hours

Job source

www.careerjet.com

Tech stack

Airflow Amazon Web Services Amazon S3 Code Review Information Engineering Extract Transform Load (ETL) Data Migration Data Vault Modeling Data Warehousing Software Design Patterns Dimensional Modeling Distributed Computing Environment

+17 more

Python (Programming Language) Performance Tuning Scrum Methodology Query Optimization SQL Stored Procedures SQL Databases Cloud Platform System Sql Optimization Snowflake Apache Spark Break Fix Pyspark Kubernetes AWS Glue AWS Data Analytics Cloudwatch Data Pipelines

Job description

We are seeking an experienced Lead Data Engineer to support complex data engineering initiatives within our insurance data and analytics practice. This role combines Deep technical expertise with strong coordination skills, working closely with onshore and offshore teams, business stakeholders, and project leadership to deliver enterprise data modernization and migration programs. The candidate will serve as a technical point of contact for cross-functional teams while remaining hands-on with cloud data technologies., Technical Delivery

Design and implement end-to-end data pipelines using PySpark, Snowflake, and AWS cloud services
Architect scalable ELT/ETL workflows and data warehouse models supporting insurance analytics use cases
Drive data migration and modernization efforts from legacy environments to cloud-native platforms
Develop and review complex SQL transformations, stored procedures, and data quality validation frameworks
Establish and enforce data engineering standards, coding best practices, and pipeline documentation
Provide hands-on troubleshooting and performance optimization across the data stack

Team Coordination & Stakeholder Engagement

Coordinate day-to-day activities across onshore and offshore data engineering teams to ensure timely delivery
Serve as a technical point of contact for business stakeholders, translating requirements into engineering deliverables
Facilitate requirement-gathering sessions, sprint planning, and status updates with project teams
Communicate project progress, risks, and dependencies to project managers and client stakeholders
Mentor junior engineers and conduct code reviews to uphold quality standards
Collaborate with data architects, analysts, and QA teams throughout the project lifecycle

Requirements

Deep experience with Snowflake including data modeling, performance tuning
Proficiency with AWS services - S3, Glue, Lambda, EMR, Redshift, Step Functions, CloudWatch
Strong experience building distributed data processing frameworks with Apache Spark / PySpark
Advanced SQL skills - complex transformations, query optimization, and dimensional modeling
Expertise in DWH design patterns - Kimball, Inmon, Data Vault, star and snowflake schemas
Demonstrated experience leading or contributing to cloud migration and legacy modernization programs
Familiarity with tools such as dbt, Apache Airflow, AWS Glue, or similar orchestration frameworks
Solid Python programming for data engineering and automation tasks, * 6 9 years of progressive experience in data engineering
Prior experience in insurance, financial services, or regulated industries preferred
Experience coordinating distributed teams across time zones (onshore/offshore model)
Demonstrated ability to engage with non-technical stakeholders and translate business requirements

Exposure to Agile/Scrum delivery methodology

About the company

Software Guidance & Assistance, Inc. (SGA) is searching for a Senior AWS Data Engineer for a C ontract assignment with one of our premier Financial Services clients located in Midt…