Senior Data Engineer

Prudential Financial, Inc.
Newark, NJ, United States
about 2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Compensation
$189,592.0
Working hours
Regular working hours
Job source

Tech stack

Airflow Amazon Web Services Amazon S3 CA Workload Automation Ae Cloudera Impala Extract Transform Load (ETL) Github Apache Hadoop Apache Hive Identity and Access Management Python (Programming Language) Apache Spark
+8 more
Gitlab Pyspark Information Technology Sentry Bitbucket Teamcity Software Version Control Jenkins

Requirements

5 years of progressive, post-baccalaureate work experience

Minimum Education Required

Bachelor’s degree in Computer Science or a related field, Bachelor’s degree in Computer Science or a related field and 5 years of progressive, post-baccalaureate work experience. Alternatively, employer will accept a Master’s degree in Computer Science or a related field and 3 years of related work experience.

Must have 3 years of experience in:

  • Python

  • Spark, Hadoop, Hive, Impala, Sentry, or Pyspark

  • Version Control Tool - BitBucket, Github, or Gitlab

  • CI/CD Pipelines - Jenkins, teamcity, gitlab or pipelines

Must have 2 years of experience in:

  • Extract-Transform-Load

  • AWS Services - S3, Glue, Lambda, or IAM

  • Job Orchestration - Step Function, Airflow, or Autosys

Telecommuting permitted up to 100% per week. Candidate may work and reside from anywhere in the U.S.

Benefits & conditions

$189,592.00 / Yearly

Hours Per Week

40

Number Of Positions, Full time employment, Monday - Friday, 40 hours per week, $189,592.00 per year. Benefits incl. medical, dental, PTO & more.

About the company

Senior Data Engineer (The Prudential Insurance Company of America, Newark, NJ):

Build high quality data services driving platform delivery. Build pipeline for data acquisition, ingestion, integration and delivery of large, complex data sets which includes structured, semi-structured and unstructured data. Optimize data delivery and re-design infrastructure for greater scalability, build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, big data distributed technologies and cloud technologies including AWS. Actively code and remove technical impediments. Produce optimal solutions that take into account non-functional requirements.

Telecommuting permitted up to 100% per week. Candidate may work and reside from anywhere in the U.S.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on juju.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:22 min

Overview of the Sentry error and performance monitoring platform

Priscila Oliveira · WWC 2023

6:14 min

Structuring CI/CD pipelines with integrated security and quality checks

Christoph Ruggenthaler · LIVE

6:36 min

Funding open source through GitHub Accelerator and Sponsors

Stormy Peters · WWC 2023

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:21 min

Installing and configuring the Sentry JavaScript SDK for applications

Priscila Oliveira · WWC 2023

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

Videos

See all

Related articles

See all