Data Engineer

Lightning Minds Inc.

Cary, NC, United States

15 days ago

Apply on www.dice.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

5 years minimum

Working hours

Regular working hours

Job source

www.dice.com

Tech stack

Agile Methodology Amazon Web Services Amazon S3 Profiling Continuous Integration Information Engineering Extract Transform Load (ETL) Data Systems Python (Programming Language) Cloud Services SQL Databases Git

+4 more

Pyspark AWS Data Analytics Api Gateway Data Pipelines

Job description

Overview: We are looking for an experienced Data Engineer with strong expertise in AWS cloud technologies to design, build, and optimize scalable data pipelines. This role involves working closely with crossfunctional teams to deliver highquality data solutions that support analytics, reporting, and business intelligence initiatives., * Develop and maintain ETL/ELT pipelines using Python, PySpark, and SQL.

Design and implement data models and integrations across multiple sources.
Leverage AWS services (S3, Glue, Lambda, Redshift, RDS, EMR, API Gateway) for data engineering solutions.
Ensure data quality, profiling, and governance across platforms.
Collaborate with stakeholders to define requirements and deliver endtoend solutions.
Optimize performance, scalability, and cost efficiency of cloud data platforms.

Requirements

5+ years of experience in data engineering.
Handson expertise with AWS Data Engineering stack (S3, Glue, Redshift, EMR, Lambda, RDS).
Strong proficiency in Python, PySpark, and SQL.
Solid understanding of data modeling, orchestration, and integration.
Experience with CI/CD pipelines, Git, and Agile methodologies.
Excellent problemsolving and communication skills.