AWS Data Engineer (Python/PySpark)

GRACEMARK, LLC

Minneapolis, MN, United States

about 1 month ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Compensation

$104,000.0

Working hours

Regular working hours

Job source

www.indeed.com

Tech stack

Java (Programming Language) Artificial Intelligence Amazon Web Services Amazon Elastic Compute Cloud Amazon S3 Big Data Databases Data Infrastructure Extract Transform Load (ETL) Data Systems Python (Programming Language) PostgreSQL

+21 more

Microsoft SQL Server Operational Databases Oracle (Applications) Software Tools Amazon Simple Notification Service (SNS) SQL Databases Data Streaming Technical Data Management Systems Cloud Platform System GitHub Copilot Snowflake AWS Lambda Cloudformation Build Management Pyspark AWS Glue AWS Data Analytics Data Pipelines Serverless Computing Amazon Elastic Mapreduce (EMR) Jenkins

Job description

Python (Mandatory)
SQL (Mandatory)
Java / Scala (Nice to have)

Databases:

Oracle (Mandatory)
SQL Server (Mandatory)
Snowflake (Nice to have)
PostgreSQL (Nice to have)

ETL / Data Engineering Tools:

PySpark (Mandatory)
Informatica (Nice to have)

Cloud Platform:

AWS (Mandatory)

AWS Technologies Required:

Amazon S3
AWS Lambda
AWS Glue
Amazon EMR
EMR Serverless
AWS Step Functions
Amazon Athena
Amazon EC2
CloudFormation Templates
SNS Topics

AWS Technologies Preferred:

Glue ETL
Kinesis Data Streams
Kinesis Firehose

AI Tools (Nice to Have):

AWS Bedrock
AWS Bedrock Agent Core
Kiro
GitHub Copilot

Build & Deployment (Nice to Have):

Jenkins
CI/CD Pipelines

Requirements

We are seeking an experienced AWS Data Engineer with strong expertise in cloud data engineering, ETL development, and data platform solutions. The ideal candidate will have hands-on experience designing, developing, and delivering scalable data solutions using AWS services, Python, SQL, and big data technologies., * Experience working in Financial Services, Brokerage, or related industries is a strong plus.

Ability to design, develop, and support enterprise-level data solutions.
Strong problem-solving skills and ability to translate business requirements into technical solutions., * Do you have a Green Card or are you a U.S. Citizen?
Do you have hands-on experience developing data solutions using Python and SQL?
Do you have hands-on experience working with Oracle and SQL Server databases?
Do you have professional experience developing ETL/data pipelines using PySpark?
Do you have hands-on experience designing and implementing AWS cloud data solutions?
Do you have experience working with key AWS data services such as S3, Lambda, Glue, EMR, EMR Serverless, Step Functions, Athena, EC2, CloudFormation, and SNS?
Do you have experience building and supporting enterprise-level data pipelines and production data solutions?
Do you have experience translating business requirements into technical data engineering solutions?