Data Engineer (AWS & Python)

ValueBase Consulting
Des Moines, United States of America
9 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 104K

Job location

Des Moines, United States of America

Tech stack

Airflow
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Big Data
Cloud Computing
Computer Programming
Information Engineering
Data Governance
Data Integration
ETL
Data Warehousing
Relational Databases
Database Queries
DevOps
Distributed Computing Environment
Revision Control Systems
Identity and Access Management
Python
Unstructured Data
Workflow Management Systems
Data Processing
Cloud Platform System
Data Ingestion
Snowflake
Spark
Database Performance
AWS Lambda
GIT
Amazon Web Services (AWS)
Data Lake
PySpark
Information Technology
Amazon Web Services (AWS)
Data Management
Cloudwatch
Software Version Control
Data Pipelines
Amazon Web Services (AWS)
Redshift
Databricks

Job description

We are seeking an experienced Data Engineer with strong expertise in AWS Cloud Services and Python development to join a long-term project in Des Moines, IA. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines, data integration solutions, and cloud-based data platforms. This role requires hands-on experience with modern data engineering practices, cloud technologies, and large-scale data processing., * Design, develop, and maintain scalable ETL/ELT pipelines using Python and AWS services.

  • Build and optimize data ingestion, transformation, and processing frameworks for structured and unstructured data.
  • Develop and manage data workflows using AWS cloud technologies.
  • Create and maintain data lakes and data warehouses to support analytics and reporting needs.
  • Collaborate with business stakeholders, data analysts, and application teams to understand data requirements.
  • Implement data quality, validation, and monitoring processes to ensure data accuracy and reliability.
  • Optimize database performance, query execution, and cloud resource utilization.
  • Develop automation scripts and reusable components for data processing and deployment.
  • Support data governance, security, and compliance initiatives.
  • Troubleshoot production issues and provide ongoing support for data platforms.

Requirements

Do you have experience in Version control?, * 5+ years of experience in Data Engineering.

  • Strong programming experience with Python.
  • Hands-on experience with AWS services, including:
  • AWS S3
  • AWS Glue
  • AWS Lambda
  • AWS Redshift
  • AWS EMR
  • AWS Athena
  • AWS RDS
  • AWS CloudWatch
  • IAM
  • Experience building ETL/ELT pipelines and data integration solutions.
  • Strong SQL skills and experience with relational databases.
  • Experience working with large-scale datasets and distributed processing frameworks.
  • Knowledge of data modeling, data warehousing, and data lake architectures.
  • Experience with version control tools such as Git.
  • Familiarity with Agile/Scrum development methodologies.
  • Strong analytical, problem-solving, and communication skills., * Experience with Apache Spark and PySpark.
  • Knowledge of Airflow or other workflow orchestration tools.
  • Experience with CI/CD pipelines and DevOps practices.
  • AWS Certifications (Preferred).
  • Experience with Snowflake, Databricks, or modern cloud analytics platforms.
  • Experience working in enterprise-scale environments., * Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
  • Equivalent work experience will also be considered.

Benefits & conditions

5.05.0 out of 5 stars Des Moines, IA Hybrid work $50 an hour - Contract

Apply for this position