AWS Data Engineer
Matlen Silver
Gilbert, United States of America
2 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
SeniorJob location
Gilbert, United States of America
Tech stack
Java
Airflow
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Big Data
Computer Programming
Continuous Integration
Data Governance
Data Infrastructure
ETL
Data Warehousing
Hadoop
Python
NoSQL
Scala
SQL Databases
Data Streaming
Web Services
Data Processing
System Availability
Spark
Infrastructure Automation Frameworks
Information Technology
Low Latency
Amazon Web Services (AWS)
Data Analytics
Amazon Web Services (AWS)
Kafka
Terraform
Software Version Control
Data Pipelines
Job description
We are seeking a skilled AWS Data Engineer to join our team. The ideal candidate will design, build and maintain scalable data pipelines and infrastructure on AWS to support data driven decision making. You will collaborate with architects, analysts and software engineers to ensure efficient data flow and accessibility across the organization., * Design, develop and maintain data pipelines using AWS services such as AWS Glue, Lamda, S3, Redshift and Athena.
- Build and optimize data models for performance and scalability
- Implement ETL/ELT processes to extract, transform and load data from various sources into AWS data stores
- Ensure data quality, integrity and security by implementing best practices and governance policies
- Monitor and optimize data pipeline performance, ensuring low latency and high availability
- Collaborate with cross-functional teams to understand data requirements and deliver solutions
- Automate data workflows using tools like AWS Step Functions or Airflow
- Implement CI/CD pipelines for data infrastructure deployment
- Stay updates on AWS data services and industry trends to recommend improvements
Requirements
- Bachelor's degree in Computer Science, Engineering or related field
- 5+ years of experience as a Data Engineer or similar role
- Strong proficiency with AWS services (e.g. S3, Glue, Macie)
- Experience with SQL and NoSQL databases
- Proficiency in programming languages like Python, Terraform, Scala or Java for data processing
- Experience with ETL tools and frameworks (e.g. AWS Glue, Apache Spark)
- Familiarity with data modeling, schema design and data warehousing concepts
- Knowledge of CI/CD practices and version control systems
- Strong problem solving skills and attention to detail
Preferred Qualifications:
- AWS Certification (e.g. AWS Certified Data Analytics, AWS Certified Solutions Architect)
- Experience with big data technologies like Hadoop, Spark or Kafka
- Knowledge of data governance and compliance frameworks
- Experience with IaC tools like Terraform
Primary SkillAmazon Web Services
Desired Skills
- AWS Certification (e.g. AWS Certified Data Analytics, AWS Certified Solutions Architect)
- Experience with big data technologies like Hadoop, Spark or Kafka
- Knowledge of data governance and compliance frameworks
- Experience with IaC tools like Terraform, * Bachelor's degree in Computer Science, Engineering or related field
- 5+ years of experience as a Data Engineer or similar role
- Strong proficiency with AWS services (e.g. S3, Glue, Macie)
- Experience with SQL and NoSQL databases
- Proficiency in programming languages like Python, Terraform, Scala or Java for data processing
- Experience with ETL tools and frameworks (e.g. AWS Glue, Apache Spark)
- Familiarity with data modeling, schema design and data warehousing concepts
- Knowledge of CI/CD practices and version control systems
- Strong problem solving skills and attention to detail
Secondary Skill NoSQL DB
Tertiary Skill Spark