AWS Senior Data Engineer
Lorven Technologies Inc
Jersey City, NJ, United States
8 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source
Tech stack
Agile Methodology
Amazon Web Services
Amazon S3
Big Data
Computer Programming
Data Architecture
Data Governance
Data Transformation
DevOps
Distributed Systems
Identity and Access Management
Python (Programming Language)
+9 more
Query Optimization
Cloud Services
Data Ingestion
Data Build Tool (dbt)
Gitlab
AWS Data Analytics
Apache Kafka
Spark Streaming
Jenkins
Requirements
- Bachelor’s degree in related field.
- Hands on programming experience in python and PYSparkAdvanced SQL skills with query optimization techniques.
- Strong understanding of AWS and distributed computing paradigms ability to design and develop data ingestion programs to process large data sets in Batch mode using Glue Lambda S3 redshift and data bricksBasic understanding of IAM roles security and AWS infrastructure
- Hands on experience to work with large scale data platforms in development of cloud solutions in AWS data platform with proven track record in driving business success
- Understanding of Dev Ops Pipelines using Jenkins GitLab should be strong in data modelling and Data architecture concepts well versed with Project management tools and Agile Methodology
- Sound knowledge of data governance principles and tools alationglue data quality mesh Capable of suggesting solution architecture for diverse technology applications.
- Ability to develop data ingestion programs to ingest realtime data from LIVE sources using Apache Kafka Spark Streaming and related technologies
- Understanding of DBT Data Build Tool for data transformation and modeling.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
BB
Benedikt Bischof
about 4 years ago
EM
Eli McGarvie
Highest Paying Tech Companies for Developers
over 3 years ago
DS
Dhannush Subramani
Top Big Data Technologies That You Need to Know
about 4 years ago
IK
Igor Khokhriakov
How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again
23 days ago
EM
Eli McGarvie
Data Engineer Salary UK
about 3 years ago
LM
Luis Minvielle
Fully Remote Software Engineer Jobs
over 2 years ago