Data Engineer

ASCENT SERVICES GROUP LLC
Bernards, United States of America
9 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate
Compensation
$ 190K

Job location

Bernards, United States of America

Tech stack

Agile Methodologies
Airflow
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Data analysis
Apache HTTP Server
Business Logic
Software Applications
Big Data
Computer Programming
Customer Data Management
ETL
Data Visualization
Data Warehousing
Identity and Access Management
Integrated Development Environments
Python
NumPy
Systems Development Life Cycle
Software Tools
Software Engineering
SQL Databases
Freeform SQL
Data Ingestion
Snowflake
Electronic Medical Records
Pandas
PySpark

Job description

Work in a fast-paced development environment to analyse, develop, and test potential use cases for the business. Involve in application development during application design for highly complex data project. Re-engineer python/Pyspark functions to perform suppression on customer data based on business logic. Optimize ETL workflows using Snowflake's native capabilities, improve data ingestion and transformation efficiency. Develop and fine-tune complex SQL queries in Snowflake for software applications. Conduct in-depth analysis of large datasets using SQL and Python. Support data visualization & analytics. Work with the team of a data scientists to make sure the analytics transform data to knowledge is a very focused and meaningful ways.

Requirements

Minimum Requirements: Degree in computer/engineering related. MS (2YRS) or BS (5YRS) of experience as software engineer. Position requires experience in SDLC & Agile methodologies; develop Python programs; write & optimize SQL Queries in Snowflake for data analysis & reporting; implement workflows using ETL; data visualization & analytics & ability to provide production support & resolve data issues. Technical skills in Programming Lang (Python, SQL, Pyspark); Snowflake Datawarehouse; Data engineering tools (Pandas, Numpy, Apache, Airflow); AWS Cloud platforms (Lamda, IAM, EC2, EMR).

Apply for this position