AWS Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+14 more
Job description
We are seeking an experienced AWS Data Engineer to design, build, and optimize scalable cloud-based data platforms. The ideal candidate will have strong expertise in AWS data services, data lake architectures, ETL/ELT pipelines, and modern big data technologies including Apache Iceberg, EMR, and Aurora., * Design and develop scalable data pipelines on AWS.
- Build and maintain data lakes using Apache Iceberg.
- Develop ETL/ELT workflows using AWS services and big data frameworks.
- Manage and optimize AWS EMR clusters for large-scale data processing.
- Design and maintain data solutions using Amazon Aurora.
- Ensure data quality, governance, security, and performance.
- Collaborate with data analysts, architects, and business stakeholders.
- Troubleshoot production issues and optimize data workflows., (āData Engineerā OR āAWS Data Engineerā)AND (Iceberg OR āApache Icebergā)AND EMRAND AuroraAND (AWS OR Amazon)AND (Python OR PySpark)
Requirements
Do you have experience in Spark implementation?, Do you have a Bachelorās degree?, * Strong experience with AWS Data Engineering services.
- Hands-on experience with Apache Iceberg, Amazon EMR, and Amazon Aurora.
- Proficiency in Python and SQL.
- Experience with Spark, PySpark, Hive, or similar big data technologies.
- Knowledge of data warehousing and data lake architectures.
- Experience with CI/CD, Git, and Agile methodologies.
- Strong problem-solving and communication skills.
Preferred Skills
- Experience with AWS Glue, Lambda, S3, Athena, Redshift, and IAM.
- Knowledge of Terraform or CloudFormation.
- Exposure to real-time data processing and streaming technologies.
Education
- Bachelorās degree in Computer Science, Information Technology, or related field.
Benefits & conditions
$100,812.05 - $151,408.06 a year - Full-time, Pulled from the full job description
- 401(k)
- Flexible schedule, * 401(k)
- Flexible schedule
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on indeed.comGood distractions
Talks and stories from around this role ā technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Top Big Data Technologies That You Need to Know
Data Engineer Salary UK
Highest Paying Tech Companies for Developers
Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud