Data Architect - Databricks Lakehouse Migration

Data Inc
United States
about 1 month ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$104,000.0 - $124,800.0
Working hours
Regular working hours
Job source

Tech stack

Architectural Patterns Microsoft Azure Big Data Databases Data Architecture Extract Transform Load (ETL) Role-Based Access Control SQL Databases Tokenization Data Classification Data Lakes Terraform
+1 more
Databricks

Job description

We are seeking an experienced Data Architect to lead the migration of 158 tables from an on-premise data warehouse into a governed Azure Databricks lakehouse. This is a hands-on architecture-and-delivery role - you will own the target data model design, tokenization boundary, medallion architecture, Unity Catalog governance, and migration execution from planning through validation.

This engagement involves sensitive financial data in a regulated environment, requiring data to be tokenized at the source before it leaves the on-premise environment.

Responsibilities

  • Design the target Databricks/Unity Catalog architecture: catalog/schema structure, medallion zone mapping (bronze/silver/gold), and table-level ownership
  • Classify source tables and columns for sensitivity (PII, NPI, account numbers) and map each to a tokenization policy
  • Design the tokenization boundary ensuring sensitive fields are tokenized on-premise before any data movement to Azure
  • Produce migration sequencing plan with wave grouping, dependency ordering, and cutover criteria
  • Define source-to-target data model including schema transformation, type mapping, and reconciliation approach
  • Design detokenization access model: authorized roles, service identities, and conditions mapped to Unity Catalog grants
  • Establish data quality and validation gates between source and target for each migration wave
  • Produce compliance documentation and as-built architecture runbooks

Requirements

  • 5+ years of data architecture experience
  • At least one large-scale data warehouse-to-cloud migration (100+ tables)
  • Hands-on experience with Azure Databricks and Unity Catalog
  • Production experience with data tokenization, masking, or format-preserving encryption
  • Strong knowledge of Delta Lake and medallion architecture patterns
  • SQL fluency and schema mapping across heterogeneous database platforms
  • Experience defining data classification schemes and mapping to technical controls

Preferred Qualifications

  • Experience with Protegrity Database Protector (or Vormetric, Voltage, or similar)
  • Financial services or regulated industry background (GLBA, NCUA, FFIEC)
  • Experience designing detokenization access models tied to identity/RBAC systems
  • Familiarity with Purview or similar data catalog/classification tool
  • Terraform or Databricks Asset Bundles experience
  • Databricks Certified Data Engineer or Data Architect certification

Benefits & conditions

Pay: $50.00 - $60.00 per hour

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

3:04 min

Database evolution and the funding behind vector databases

Erik Bamberg · LIVE

1:34 min

Essential commands for running and testing Terraform configurations

Hennie Francis · LIVE

3:38 min

Architecting a unified data and machine learning workbench

Kapil Gupta Kapil Gupta · World Congress 2025

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

Videos

See all

Related articles

See all