AWS Data Engineer

Digital Dhara LLC

Atlanta, GA, United States

25 days ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Working hours

Regular working hours

Job source

www.dice.com

Tech stack

Application Programming Interfaces (APIs) Amazon Web Services Amazon S3 Databases Continuous Integration Extract Transform Load (ETL) DevOps Amazon DynamoDB Identity and Access Management Performance Tuning Cloud Services SQL Databases

+10 more

Data Streaming Data Ingestion System Availability Cloudformation Amazon Relational Database Service Data Lakes Pyspark Functional Programming Amazon Simple Queue Service (SQS) Terraform

Job description

Design, develop, and maintain batch and streaming ETL/ELT pipelinesusing AWS services (Glue, Lambda, Step Functions, etc.).
Implement data ingestion frameworksfrom diverse sources (APIs, databases, streaming platforms).
Ensure data quality, governance, and securityacross all pipelines.
Build and optimize data lakes and warehousesleveraging Amazon S3, Redshift, Athena, and Lake Formation.
Collaborate with data scientists, analysts, and business stakeholders to deliver reliable datasets.
Monitor and troubleshoot data workflows, ensuring high availability and performance.
Stay updated with emerging AWS technologies and recommend improvements.

Requirements

Strong experience with AWS cloud services: S3, Glue, Redshift, EMR, Kinesis, Lambda, DynamoDB, RDS, Athena, SNS. SQS.
Proficiency in SQL, Pythonand PySpark
Knowledge of data modeling, schema design, and performance tuning.
Familiarity with CI/CD pipelinesand DevOps practices tool (Terraform, CloudFormation).
Experience with security best practices(IAM, encryption, compliance).