Data Engineer with Python

Here Technologies
Reston, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English

Job location

Reston, United States of America

Tech stack

Amazon Web Services (AWS)
Big Data
Continuous Integration
Data Validation
ETL
Data Transformation
DevOps
Python
Query Optimization
SQL Databases
Data Storage Technologies
GIT
PySpark
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Software Version Control
Data Pipelines
Serverless Computing
Redshift

Job description

Seeking an AWS Data Engineer to design, build, and maintain scalable data pipelines and ETL solutions using Python/PySpark and AWS managed services to support analytics and data product needs., * Build and maintain ETL pipelines using Python and PySpark on AWS Glue and other compute platforms

  • Orchestrate workflows with AWS Step Functions and serverless components (Lambda)
  • Implement messaging and event-driven patterns using AWS SNS and SQS
  • Design and optimize data storage and querying in Amazon Redshift
  • Write performant SQL for data transformations, validation, and reporting
  • Ensure data quality, monitoring, error handling, and operational support for pipelines
  • Collaborate with data consumers, engineers, and stakeholders to translate requirements into solutions
  • Contribute to CI/CD, infrastructure-as-code, and documentation for reproducible deployments

Requirements

  • Strong experience with Python and PySpark for large-scale data processing
  • Proven hands-on experience with AWS services: Lambda, SNS, SQS, Glue, Redshift, Step Functions
  • Solid SQLSQL skills and familiarity with data modeling and query optimization
  • Experience with ETL best practices, data quality checks, and monitoring/alerting
  • Familiarity with version control (Git) and basic DevOps/CI-CD workflows

Apply for this position