INTL - Data Engineer

Insight Global

St. Louis, MO, United States

2 months ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Experienced

Experience required

2 years minimum

Working hours

Regular working hours

Job source

dejobs.org

Tech stack

Business Analytics Applications Microsoft Azure Computer Programming Information Engineering Data Governance Extract Transform Load (ETL) Data Security Python (Programming Language) SQL Databases Data Streaming Azure Service Bus Azure Data Factory

+7 more

Apache Spark Information Technology Collibra Non-relational Database Terraform Data Pipelines Databricks

Job description

Insight Global is seeking a Data Engineer to support a large beverage company’s data and analytics initiatives. This delivery-focused role is responsible for designing, building, and maintaining scalable data pipelines and analytics solutions on Azure Databricks, including Unity Catalog. The Data Engineer will develop and optimize ETL/ELT pipelines and Apache Spark jobs, ensure data quality and reliability, and collaborate with product owners and analytics teams to translate business needs into robust technical solutions.

Requirements

Bachelor’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.

3-5 years of experience in data engineering roles.

At least 2 years of hands-on experience with Azure Databricks and Apache Spark.

Strong programming skills in Python.

Proficiency in SQL and experience working with both relational and non-relational databases. Azure certifications such as Azure Data Engineer Associate, or Databricks certifications.

Experience with streaming data processing (e.g., Structured Streaming, Event Hubs).

Knowledge of infrastructure as code (Terraform/Terragrunt or ARM templates).

Familiarity with data governance tools and practices.

Experience with Unity Catalog, data governance, and data security/compliance concepts.