INTL - Data Engineer

Insight Global
St. Louis, United States of America
1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate

Job location

Remote
St. Louis, United States of America

Tech stack

Business Analytics Applications
Azure
Computer Programming
Information Engineering
Data Governance
ETL
Data Security
Python
SQL Databases
Data Streaming
Azure
Azure
Spark
Information Technology
Collibra
Non-relational Database
Terraform
Data Pipelines
Databricks

Job description

Insight Global is seeking a Data Engineer to support a large beverage company's data and analytics initiatives. This delivery-focused role is responsible for designing, building, and maintaining scalable data pipelines and analytics solutions on Azure Databricks, including Unity Catalog. The Data Engineer will develop and optimize ETL/ELT pipelines and Apache Spark jobs, ensure data quality and reliability, and collaborate with product owners and analytics teams to translate business needs into robust technical solutions.

Requirements

Bachelor's degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.

3-5 years of experience in data engineering roles.

At least 2 years of hands-on experience with Azure Databricks and Apache Spark.

Strong programming skills in Python.

Proficiency in SQL and experience working with both relational and non-relational databases. Azure certifications such as Azure Data Engineer Associate, or Databricks certifications.

Experience with streaming data processing (e.g., Structured Streaming, Event Hubs).

Knowledge of infrastructure as code (Terraform/Terragrunt or ARM templates).

Familiarity with data governance tools and practices.

Experience with Unity Catalog, data governance, and data security/compliance concepts.

Apply for this position