AWS Data Engineer

Sage IT Inc

Reston, United States of America

yesterday

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Working hours

Regular working hours

Languages

English

Experience level

Senior

Reston, United States of America

Amazon Web Services (AWS)

Data analysis

Big Data

Continuous Integration

Hadoop

Hive

Python

SQL Databases

Data Processing

Spark

Electronic Medical Records

Gitlab

Terraform

Web Api

Qualifications (Data Engineer/ Python Developer)

10+ years hands-on Python development experience for big data application.
Extensive working experience in implementing scalable and efficient data processing pipelines using big data technologies, such as Hadoop/EMR, Spark, Hive.
Strong development experience in AWS platforms/services such as Lambda, Eventbridge, Step Functions, Redshift, S3, Glue.
Extensive hands-on development experience in making API calls, SQL queries, data manipulation/transformation, analysis and visualization.
Strong experience in data analysis/mining, hands-on experience on analyzing large datasets and extracting meaningful insights.
Solid understanding and hand-on implementation experience in CI/CD pipeline. Familiar with tools such as Gitlab/Terraform.
Critical thinking and strong analytical skills to drive solutions, alternative plans, and conclusions
Collaborates effectively and forms positive partnerships with team members in groups and levels across a matrixed organization
Possess strong analytical and problem-solving skills

Skills:

Required 10+ years of Python development experience for big data application
Required 5+ years of development experience in AWS platforms/services such as EMR, Lambda, Eventbridge, Step Functions, Redshift, S3, Glue
Required 5+ years of development experience in making API calls, SQL queries, Spark, data manipulation/transformation, analysis and visualization
Hands on experience with CI/CD pipeline tools such as Gitlab/Terraform