AWS Data Engineer
Digital Dhara LLC
Atlanta, United States of America
4 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
EnglishJob location
Atlanta, United States of America
Tech stack
API
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Databases
Continuous Integration
ETL
DevOps
Amazon DynamoDB
Identity and Access Management
Performance Tuning
Cloud Services
SQL Databases
Data Streaming
Data Ingestion
System Availability
Cloudformation
Amazon Web Services (AWS)
Data Lake
PySpark
Functional Programming
Amazon Web Services (AWS)
Terraform
Job description
- Design, develop, and maintain batch and streaming ETL/ELT pipelinesusing AWS services (Glue, Lambda, Step Functions, etc.).
- Implement data ingestion frameworksfrom diverse sources (APIs, databases, streaming platforms).
- Ensure data quality, governance, and securityacross all pipelines.
- Build and optimize data lakes and warehousesleveraging Amazon S3, Redshift, Athena, and Lake Formation.
- Collaborate with data scientists, analysts, and business stakeholders to deliver reliable datasets.
- Monitor and troubleshoot data workflows, ensuring high availability and performance.
- Stay updated with emerging AWS technologies and recommend improvements.
Requirements
- Strong experience with AWS cloud services: S3, Glue, Redshift, EMR, Kinesis, Lambda, DynamoDB, RDS, Athena, SNS. SQS.
- Proficiency in SQL, Pythonand PySpark
- Knowledge of data modeling, schema design, and performance tuning.
- Familiarity with CI/CD pipelinesand DevOps practices tool (Terraform, CloudFormation).
- Experience with security best practices(IAM, encryption, compliance).