Job location
Newark, United States of America
Tech stack
Airflow
Amazon Web Services (AWS)
Amazon Web Services (AWS)
CA Workload Automation Ae
Cloudera Impala
ETL
Github
Hadoop
Hive
Identity and Access Management
Python
Spark
Gitlab
PySpark
Information Technology
Sentry
Bitbucket
TeamCity
Software Version Control
Jenkins
Requirements
5 years of progressive, post-baccalaureate work experience
Minimum Education Required
Bachelor's degree in Computer Science or a related field, Bachelor's degree in Computer Science or a related field and 5 years of progressive, post-baccalaureate work experience. Alternatively, employer will accept a Master's degree in Computer Science or a related field and 3 years of related work experience.
Must have 3 years of experience in:
-
Python
-
Spark, Hadoop, Hive, Impala, Sentry, or Pyspark
-
Version Control Tool - BitBucket, Github, or Gitlab
-
CI/CD Pipelines - Jenkins, teamcity, gitlab or pipelines
Must have 2 years of experience in:
-
Extract-Transform-Load
-
AWS Services - S3, Glue, Lambda, or IAM
-
Job Orchestration - Step Function, Airflow, or Autosys
Telecommuting permitted up to 100% per week. Candidate may work and reside from anywhere in the U.S.
Benefits & conditions
$189,592.00 / Yearly
Hours Per Week
40
Number Of Positions, Full time employment, Monday - Friday, 40 hours per week, $189,592.00 per year. Benefits incl. medical, dental, PTO & more.
About the company
Senior Data Engineer (The Prudential Insurance Company of America, Newark, NJ):
Build high quality data services driving platform delivery. Build pipeline for data acquisition, ingestion, integration and delivery of large, complex data sets which includes structured, semi-structured and unstructured data. Optimize data delivery and re-design infrastructure for greater scalability, build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, big data distributed technologies and cloud technologies including AWS. Actively code and remove technical impediments. Produce optimal solutions that take into account non-functional requirements.
Telecommuting permitted up to 100% per week. Candidate may work and reside from anywhere in the U.S.