Data Engineer

ASCENT SERVICES GROUP LLC

Bernards, NJ, United States

2 months ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Starter

Experience required

1 year minimum

Compensation

$189,000.0

Working hours

Regular working hours

Job source

juju.com

Tech stack

Java (Programming Language) Agile Methodology Big Data Unix Cloud Computing Information Engineering Apache Hadoop Apache Hive Python (Programming Language) Operational Databases Cloud Services Software Deployment

+7 more

Google Cloud Data Ingestion Apache Spark Build Management Pyspark Information Technology Restful APIs

Job description

Building and supporting large-scale, business critical systems on Public Cloud Platform (Google Cloud Platform). Apply Data Engineering concept in large IT projects utilizing in Big Data/Hadoop Eco Systems. Develop and implement technical efforts to design, build, and deploy Cloud applications at the direction of lead architects, including large-scale data processing. Design and build production data pipelines from data ingestion to consumption within a hybrid big data architecture, using GCP Data Engineering & Python/Pyspark. Design, build and maintain Java based REST API’s to expose data and integrate with downstream applications. Collaborating with engineering and development teams to evaluate and identify optimal cloud solutions. Identifying, analyzing, and resolving infrastructure vulnerabilities and application deployment issues. Ability to mentor lower-level engineers with 1-2 years of work experience.

Requirements

Minimum Requirements: Degree in computer/science/engineering related. MS (3YRS) or BS (5YRS) of work experience in data engineering. Position requires expertise in GCP Data Engineering; Hadoop & Big Data Technologies (Hive, Spark, Unix Scripting);Java API development; Cloud Technologies; Python, Pyspark, Aginity Pro, and Agile methodologies. Ability to mentor data engineering teams.