Azure Data Engineer: INTL

Insight Global

Plano, TX, United States

2 months ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

5 years minimum

Working hours

Regular working hours

Job source

dejobs.org

Tech stack

Microsoft Azure Continuous Integration Data Architecture Data Governance Data Warehousing Relational Databases DevOps Python (Programming Language) Performance Tuning Power BI Standard Sql SQL Databases

+10 more

Tableau (Software) Azure Data Factory Apache Spark Data Lakes Pyspark Presto Data Pipelines Sql Tuning Serverless Computing Databricks

Job description

A fortune 100 client is seeking a highly skilled and experienced Senior Data Engineer to support an enterprise-level migration of the metadata layer from Presto to Unity Catalog within the Databricks Lakehouse Platform. This role requires deep expertise in Databricks, Spark, and modern data architecture, with a strong focus on data governance, performance optimization, and scalable pipeline development. The two additional data engineers will join the client’s 2 current team members and will work on an individual basis to complete the migration effort.

Requirements

8+ years experience as a Data Engineer with a minimum 5 years of experiences in Azure tool stack (Databricks, ADF, Synapse Analytics)
Strong expertise in writing complex SQL and transformations
Ability to write, review and examine code written in Python and PySpark
Proficient in Devops CICD
Expertise in RDBMS
Fundamental knowledge of Data Warehousing concepts
SQL and SQL tuning within Data Lake (Delta Format) * Azure services: azure functions, event grid
Tableau & PowerBI
Prior PepsiCo experience
Databricks certification
Local to HYD