AWS Data Engineer

JSR Tech Consulting
South Orange, NJ, United States
8 days ago
Apply on www.disabledperson.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours

Tech stack

Amazon Web Services Data Analysis Continuous Integration Data Governance Extract Transform Load (ETL) Data Warehousing Digital Assets SQL Databases Data Processing Data Lakes Pyspark Semi-structured Data
+3 more
AWS Glue AWS Data Analytics Data Pipelines

Requirements

  1. Design and development of batch and real-time data pipelines using AWS Data & Analytics Services such as AWS Glue, Athena, Lambda, Redshift etc.,

  2. Experience in building complex data processing and ETL jobs using Pyspark and SQL

  3. Experience in ingesting and processing structured and semi-structured data

  4. Exposure to data warehousing, data lake and lake house architectures

  5. Good understanding of different data modeling techniques

  6. Ability to optimize cost and improve performance of data pipelines

  7. Exposure to CI/CD process

  8. Knowledge of best practices in securing data pipelines and data assets in AWS.

  9. Knowledge of data quality and data governance processes is a plus.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.disabledperson.com
Prepare application

Good distractions

Loading talks and stories from around this role…