REMOTE Data Engineer in

Insight Global
Bloomington, United States of America
6 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Bloomington, United States of America

Tech stack

Airflow
Azure
Data Validation
Data Systems
Github
Python
Power BI
Standard Sql
SAS (Software)
SQL Databases
Web Analytics
PySpark
Data Pipelines
Databricks

Job description

Insight Global is seeking 2 Sr. Data Engineers to join a Personal Campaign Operations team. This is a very known, visible and well-funded team bringing in millions of $s for the company. This team supports the entire enterprise (care delivery and health plan marketing), and works in a collaborative, cross-functional environment with both developers and campaign owners. This person must be flexible as they will be working with different people on different campaigns at one time, and have to pivot according to changing priorities.

This person will overall be responsible to:

  • Design, develop, and implement end-to-end data solutions using Azure Databricks.

  • Convert current SQL to Python code in Databricks.

  • Modify and maintain data pipelines.

  • Write, test, and optimize PySpark and SQL scripts to transform and load high volumes of structured data.

  • Update or maintain existing data pipelines in a production setting.

  • Ensure data quality and integrity by implementing data validation and cleansing processes.

  • Demonstrate strong verbal communication and critical thinking skills, working well within a team environment and not being afraid to speak up.

Requirements

5+ years of experience as a Data Engineer working with SQL & Python

Databricks experience Marketing campaign/digital analytics experience

Experience in other technologies related to their tech stack (Azure, PySpark, GitHub, PowerBI, Airflow)

Both cloud and on-prem experience in order to support SAS to cloud migration work

Relevant certifications (Azure, Databricks etc)

Apply for this position