AWS Data Engineer

Propertyvalue Quantum Technologies Llc

Glenview, IL, United States

2 months ago

Apply on dice.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Working hours

Regular working hours

Job source

dice.com

Tech stack

Application Programming Interfaces (APIs) Amazon Web Services Amazon S3 Computer Programming Information Engineering Data Governance Extract Transform Load (ETL) Data Security Data Warehousing Software Debugging Amazon DynamoDB Identity and Access Management

+16 more

Python (Programming Language) Cloud Services Data Storage Technologies Data Ingestion Infrastructure as Code (IaC) Cloudformation AWS Glue AWS Data Analytics Data Management Functional Programming Cloudwatch Api Gateway Data Pipelines Serverless Computing Amazon Redshift Golang

Job description

Hands-on AWS Data Engineer to design, build, and optimize scalable data pipelines. Will use Python/Golang to engineer serverless ETL solutions, manage secure data lakes, and resolve complex architectural challenges independently with minimal supervision., Pipeline Development: Build, maintain, and scale robust data ingestion and processing pipelines using Lambda, API Gateway and AWS Glue. Architecture & Infrastructure: Provision and manage infrastructure-as-code (IaC) using AWS CloudFormation. Data Management & Governance: Design and implement data storage/retrieval solutions leveraging DynamoDB and build compliant data governance frameworks via Lake Formation. Security: Implement strict access control, masking, and least-privilege security policies using AWS IAM. Troubleshooting: Independently analyze, debug, and resolve data pipeline or infrastructure issues with high autonomy and quick problem-solving

Requirements

Core Languages: Strong programming proficiency in Python or Golang. AWS Compute & API: Deep hands-on experience with AWS Lambda, API Gateway, and DynamoDB. Data Engineering & Governance: Advanced knowledge of AWS Glue, IAM, and Lake Formation. Infrastructure as Code (IaC): Proven track record building and updating CloudFormation templates. Soft Skills: Exceptional communication skills, a proactive hands-on attitude, strong analytical problem-solving, and the ability to troubleshoot independently with minimal support.

Preferred Qualifications: Additional Cloud Services: Familiarity with AWS Step Functions, S3 lifecycle policies, and Amazon CloudWatch. Data Warehousing: Prior experience working with Amazon Redshift or Athena is a plus.