Data Architect - Databricks Lakehouse Migration
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+1 more
Job description
We are seeking an experienced Data Architect to lead the migration of 158 tables from an on-premise data warehouse into a governed Azure Databricks lakehouse. This is a hands-on architecture-and-delivery role - you will own the target data model design, tokenization boundary, medallion architecture, Unity Catalog governance, and migration execution from planning through validation.
This engagement involves sensitive financial data in a regulated environment, requiring data to be tokenized at the source before it leaves the on-premise environment.
Responsibilities
- Design the target Databricks/Unity Catalog architecture: catalog/schema structure, medallion zone mapping (bronze/silver/gold), and table-level ownership
- Classify source tables and columns for sensitivity (PII, NPI, account numbers) and map each to a tokenization policy
- Design the tokenization boundary ensuring sensitive fields are tokenized on-premise before any data movement to Azure
- Produce migration sequencing plan with wave grouping, dependency ordering, and cutover criteria
- Define source-to-target data model including schema transformation, type mapping, and reconciliation approach
- Design detokenization access model: authorized roles, service identities, and conditions mapped to Unity Catalog grants
- Establish data quality and validation gates between source and target for each migration wave
- Produce compliance documentation and as-built architecture runbooks
Requirements
- 5+ years of data architecture experience
- At least one large-scale data warehouse-to-cloud migration (100+ tables)
- Hands-on experience with Azure Databricks and Unity Catalog
- Production experience with data tokenization, masking, or format-preserving encryption
- Strong knowledge of Delta Lake and medallion architecture patterns
- SQL fluency and schema mapping across heterogeneous database platforms
- Experience defining data classification schemes and mapping to technical controls
Preferred Qualifications
- Experience with Protegrity Database Protector (or Vormetric, Voltage, or similar)
- Financial services or regulated industry background (GLBA, NCUA, FFIEC)
- Experience designing detokenization access models tied to identity/RBAC systems
- Familiarity with Purview or similar data catalog/classification tool
- Terraform or Databricks Asset Bundles experience
- Databricks Certified Data Engineer or Data Architect certification
Benefits & conditions
Pay: $50.00 - $60.00 per hour
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Top Big Data Technologies That You Need to Know
Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?
What Are The Top Skills Required For Azure Developers?
Data Engineer Salary UK