Data Engineer (AWS & Python)

ValueBase Consulting

Des Moines, IA, United States

about 2 months ago

Role details

Contract type

Temporary contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

5 years minimum

Compensation

$104,000.0

Working hours

Regular working hours

Job source

indeed.com

Tech stack

Airflow Amazon Web Services Amazon S3 Big Data Cloud Computing Computer Programming Information Engineering Data Governance Data Integration Extract Transform Load (ETL) Data Warehousing Relational Databases

+28 more

Database Queries DevOps Distributed Computing Environment Revision Control Systems Identity and Access Management Python (Programming Language) Unstructured Data Workflow Management Systems Data Processing Cloud Platform System Data Ingestion Snowflake Apache Spark Database Performance AWS Lambda Git Amazon Relational Database Service Data Lakes Pyspark Information Technology AWS Glue Data Management Cloudwatch Software Version Control Data Pipelines Amazon Elastic Mapreduce (EMR) Amazon Redshift Databricks

Job description

We are seeking an experienced Data Engineer with strong expertise in AWS Cloud Services and Python development to join a long-term project in Des Moines, IA. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines, data integration solutions, and cloud-based data platforms. This role requires hands-on experience with modern data engineering practices, cloud technologies, and large-scale data processing., * Design, develop, and maintain scalable ETL/ELT pipelines using Python and AWS services.

Build and optimize data ingestion, transformation, and processing frameworks for structured and unstructured data.
Develop and manage data workflows using AWS cloud technologies.
Create and maintain data lakes and data warehouses to support analytics and reporting needs.
Collaborate with business stakeholders, data analysts, and application teams to understand data requirements.
Implement data quality, validation, and monitoring processes to ensure data accuracy and reliability.
Optimize database performance, query execution, and cloud resource utilization.
Develop automation scripts and reusable components for data processing and deployment.
Support data governance, security, and compliance initiatives.
Troubleshoot production issues and provide ongoing support for data platforms.

Requirements

Do you have experience in Version control?, * 5+ years of experience in Data Engineering.

Strong programming experience with Python.
Hands-on experience with AWS services, including:
AWS S3
AWS Glue
AWS Lambda
AWS Redshift
AWS EMR
AWS Athena
AWS RDS
AWS CloudWatch
IAM
Experience building ETL/ELT pipelines and data integration solutions.
Strong SQL skills and experience with relational databases.
Experience working with large-scale datasets and distributed processing frameworks.
Knowledge of data modeling, data warehousing, and data lake architectures.
Experience with version control tools such as Git.
Familiarity with Agile/Scrum development methodologies.
Strong analytical, problem-solving, and communication skills., * Experience with Apache Spark and PySpark.
Knowledge of Airflow or other workflow orchestration tools.
Experience with CI/CD pipelines and DevOps practices.
AWS Certifications (Preferred).
Experience with Snowflake, Databricks, or modern cloud analytics platforms.
Experience working in enterprise-scale environments., * Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.
Equivalent work experience will also be considered.