Middle/Senior Big Data Software Engineer (Python + AWS)

SoftServe, Inc.

United States

13 days ago

Apply on arc.dev

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

4 years minimum

Working hours

Regular working hours

Languages

English

Job source

arc.dev

Tech stack

Clean Code Principles Amazon Web Services Amazon S3 Data Analysis Big Data Information Engineering Data Integration Extract Transform Load (ETL) Dataspaces Distributed Computing Environment Amazon DynamoDB Github

+18 more

Python (Programming Language) Cloud Services DataOps Software Engineering SQL Databases Datadog Data Processing Cloud Platform System Delivery Pipeline Backend Cloudformation Pyspark Deployment Automation AWS Data Analytics Cloudwatch Data Pipelines Amazon Elastic Mapreduce (EMR) Amazon Redshift

Job description

In this role, you will contribute to building and operating cloud-native data platforms that combine backend engineering with modern data processing solutions. Working across AWS-based data ecosystems, you will develop scalable data pipelines, optimize distributed processing workloads, and support backend services that power business-critical data operations. You will also have the opportunity to work with Go as part of the project while collaborating with cross-functional teams to deliver reliable, production-ready solutions., * Design, develop, and maintain scalable data pipelines and ETL workflows using AWS data services

Build and support backend services for data integrations and processing workflows using Go and other backend technologies
Develop and optimize distributed data processing solutions using Python (PySpark) and Amazon EMR
Improve the performance, reliability, and cost efficiency of data processing jobs and cloud-native data platforms
Manage Infrastructure as Code, CI/CD pipelines, and deployment workflows using CloudFormation and GitHub Actions
Monitor production systems, implement observability best practices, and troubleshoot production issues using Datadog and CloudWatch
Collaborate with cross-functional teams to design, implement, and continuously improve backend and data platform solutions
Ensure high-quality code, testing, documentation, and engineering best practices throughout the software development lifecycle
Work with adjusted hours, extending until 20:00-20:30 Kyiv time

Requirements

4+ years of experience in Data Engineering or Backend Engineering
Strong experience designing and building data pipelines, ETL workflows, and cloud-based data platforms on AWS
Hands-on experience with Python (PySpark) and SQL for data processing and analytics
Practical knowledge of AWS services such as Amazon S3, Glue, EMR, Step Functions, Athena, Redshift, DynamoDB, and CloudFormation
Experience building or supporting backend services; familiarity with Go or willingness to work with Go in a production environment
Experience with CI/CD pipelines and deployment automation using GitHub Actions or similar tools
Experience with observability and monitoring solutions such as Datadog and CloudWatch
Strong analytical, troubleshooting, and problem-solving skills with the ability to take ownership of production systems and drive reliability improvements
Upper-intermediate or higher level of English