AWS Data Engineer (Python/PySpark)
GRACEMARK, LLC
Minneapolis, United States of America
8 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Compensation
$ 104KJob location
Minneapolis, United States of America
Tech stack
Java
Artificial Intelligence
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Big Data
Databases
Data Infrastructure
ETL
Data Systems
Python
PostgreSQL
Microsoft SQL Server
Operational Databases
Oracle Applications
Software Tools
Amazon Web Services (AWS)
SQL Databases
Data Streaming
Technical Data Management Systems
Cloud Platform System
GitHub Copilot
Snowflake
AWS Lambda
Cloudformation
Build Management
PySpark
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Data Pipelines
Serverless Computing
Amazon Web Services (AWS)
Jenkins
Job description
- Python (Mandatory)
- SQL (Mandatory)
- Java / Scala (Nice to have)
Databases:
- Oracle (Mandatory)
- SQL Server (Mandatory)
- Snowflake (Nice to have)
- PostgreSQL (Nice to have)
ETL / Data Engineering Tools:
- PySpark (Mandatory)
- Informatica (Nice to have)
Cloud Platform:
- AWS (Mandatory)
AWS Technologies Required:
- Amazon S3
- AWS Lambda
- AWS Glue
- Amazon EMR
- EMR Serverless
- AWS Step Functions
- Amazon Athena
- Amazon EC2
- CloudFormation Templates
- SNS Topics
AWS Technologies Preferred:
- Glue ETL
- Kinesis Data Streams
- Kinesis Firehose
AI Tools (Nice to Have):
- AWS Bedrock
- AWS Bedrock Agent Core
- Kiro
- GitHub Copilot
Build & Deployment (Nice to Have):
- Jenkins
- CI/CD Pipelines
Requirements
We are seeking an experienced AWS Data Engineer with strong expertise in cloud data engineering, ETL development, and data platform solutions. The ideal candidate will have hands-on experience designing, developing, and delivering scalable data solutions using AWS services, Python, SQL, and big data technologies., * Experience working in Financial Services, Brokerage, or related industries is a strong plus.
- Ability to design, develop, and support enterprise-level data solutions.
- Strong problem-solving skills and ability to translate business requirements into technical solutions., * Do you have a Green Card or are you a U.S. Citizen?
- Do you have hands-on experience developing data solutions using Python and SQL?
- Do you have hands-on experience working with Oracle and SQL Server databases?
- Do you have professional experience developing ETL/data pipelines using PySpark?
- Do you have hands-on experience designing and implementing AWS cloud data solutions?
- Do you have experience working with key AWS data services such as S3, Lambda, Glue, EMR, EMR Serverless, Step Functions, Athena, EC2, CloudFormation, and SNS?
- Do you have experience building and supporting enterprise-level data pipelines and production data solutions?
- Do you have experience translating business requirements into technical data engineering solutions?