Data Lead / Senior Data Engineer - Databricks Migration

Xl Impex Inc Dba
Kansas City, United States of America
18 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Kansas City, United States of America

Tech stack

Azure
Continuous Integration
Data Architecture
Data Migration
Key Management
Teradata
Azure
Delivery Pipeline
Data Lake
Databricks

Job description

Customer is undergoing a large-scale migration from Teradata to Databricks over the last 18 months. Data lake hydration is still in progress, with multiple layers supporting domain-based transformations. Hundreds of MIS reports currently running on Teradata must be successfully migrated and validated in the target Databricks environment. The client requires immediate implementation and subsequently scalable testing services.

Requirements

Strong expertise in Databricks Lakehouse architecture Hands-on experience with Databricks DLT Meta (Delta Live Tables) (not Unity Catalog) Expertise in using Azure (Stated requirement is Azure, ADLS Gen 2, Azure Data Factory, Azure Key Vault, Azure DevOps) Expertise in CI/CD implementation in Azure DevOps for deployment pipelines Experience designing scalable testing and validation frameworks for data migration projects Proven experience in Teradata to Databricks migration programs Ability to support multi layer implementation and optimization Strong understanding of enterprise reporting/data reconciliation processes

Preferred Profile: Senior Data Leads / Engineers with real project implementation expertise (not just trained/certified resources) Experience handling large-scale enterprise data transformation programs Ability to work in hybrid onsite/offshore delivery model

Apply for this position