Azure Data Engineer: INTL

Insight Global
Plano, United States of America
1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Plano, United States of America

Tech stack

Azure
Continuous Integration
Data Architecture
Data Governance
Data Warehousing
Relational Databases
DevOps
Python
Performance Tuning
Power BI
Standard Sql
SQL Databases
Tableau
Azure
Spark
Data Lake
PySpark
Presto
Data Pipelines
Sql Tuning
Serverless Computing
Databricks

Job description

A fortune 100 client is seeking a highly skilled and experienced Senior Data Engineer to support an enterprise-level migration of the metadata layer from Presto to Unity Catalog within the Databricks Lakehouse Platform. This role requires deep expertise in Databricks, Spark, and modern data architecture, with a strong focus on data governance, performance optimization, and scalable pipeline development. The two additional data engineers will join the client's 2 current team members and will work on an individual basis to complete the migration effort.

Requirements

  • 8+ years experience as a Data Engineer with a minimum 5 years of experiences in Azure tool stack (Databricks, ADF, Synapse Analytics)

  • Strong expertise in writing complex SQL and transformations

  • Ability to write, review and examine code written in Python and PySpark

  • Proficient in Devops CICD

  • Expertise in RDBMS

  • Fundamental knowledge of Data Warehousing concepts

  • SQL and SQL tuning within Data Lake (Delta Format) * Azure services: azure functions, event grid

  • Tableau & PowerBI

  • Prior PepsiCo experience

  • Databricks certification

  • Local to HYD

Apply for this position