Data Engineer

ASCENT SERVICES GROUP LLC

Bernards, NJ, United States

about 1 month ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Experienced

Experience required

2 years minimum

Compensation

$189,600.0

Working hours

Regular working hours

Job source

www.juju.com

Tech stack

Agile Methodology Airflow Amazon Web Services Amazon Elastic Compute Cloud Data Analysis Apache HTTP Server Business Logic Software Applications Big Data Computer Programming Customer Data Management Extract Transform Load (ETL)

+16 more

Data Visualization Data Warehousing Identity and Access Management Integrated Development Environments Python (Programming Language) NumPy Systems Development Life Cycle Software Tools Software Engineering SQL Databases Freeform SQL Data Ingestion Snowflake Electronic Medical Records Pandas Pyspark

Job description

Work in a fast-paced development environment to analyse, develop, and test potential use cases for the business. Involve in application development during application design for highly complex data project. Re-engineer python/Pyspark functions to perform suppression on customer data based on business logic. Optimize ETL workflows using Snowflake’s native capabilities, improve data ingestion and transformation efficiency. Develop and fine-tune complex SQL queries in Snowflake for software applications. Conduct in-depth analysis of large datasets using SQL and Python. Support data visualization & analytics. Work with the team of a data scientists to make sure the analytics transform data to knowledge is a very focused and meaningful ways.

Requirements

Minimum Requirements: Degree in computer/engineering related. MS (2YRS) or BS (5YRS) of experience as software engineer. Position requires experience in SDLC & Agile methodologies; develop Python programs; write & optimize SQL Queries in Snowflake for data analysis & reporting; implement workflows using ETL; data visualization & analytics & ability to provide production support & resolve data issues. Technical skills in Programming Lang (Python, SQL, Pyspark); Snowflake Datawarehouse; Data engineering tools (Pandas, Numpy, Apache, Airflow); AWS Cloud platforms (Lamda, IAM, EC2, EMR).