AWS Data Engineer

JSR Tech Consulting

Newark, NJ, United States

6 days ago

Apply on www.disabledperson.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Compensation

$135,200.0 - $166,400.0

Working hours

Regular working hours

Job source

www.disabledperson.com

Tech stack

Amazon Web Services Data Analysis Continuous Integration Information Engineering Data Governance Extract Transform Load (ETL) Data Security Data Warehousing Digital Assets Standard Sql Data Processing Build Management

+5 more

Data Lakes Pyspark Semi-structured Data AWS Data Analytics Data Pipelines

Job description

Join a leading financial firm on a long-term contract engagement
Design and build scalable batch and real-time data pipelines on AWS, * Design and develop batch and real-time data pipelines using AWS Data and Analytics services such as Glue, Athena, Lambda, and Redshift
Build complex data processing and ETL jobs using PySpark and SQL
Ingest and process structured and semi-structured data
Optimize data pipelines for cost efficiency and performance
Apply best practices to secure data pipelines and data assets in AWS
Support CI/CD processes for data engineering workflows

Requirements

Hands-on experience with AWS Glue, Athena, Lambda, Redshift, and related AWS data services
Strong experience building ETL jobs with PySpark and SQL
Experience working with structured and semi-structured data
Exposure to data warehouse, data lake, and lakehouse architectures
Solid understanding of data modeling techniques
Exposure to CI/CD processes
Knowledge of AWS data security best practices

Nice to Have

Knowledge of data quality and data governance processes

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.disabledperson.com

Prepare application

Good distractions

Loading talks and stories from around this role…