Databricks Champion Architect

iO Associates
London, UK
about 1 month ago
Apply on www.careerboard.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
2 years minimum
Compensation
£130,000.0 - £169,000.0
Working hours
Regular working hours

Tech stack

Artificial Intelligence Amazon Web Services Microsoft Azure Continuous Integration Software Design Patterns Role-Based Access Control Search Technologies Data Lakes Cloud Integration Databricks

Job description

We’re hiring a Databricks Champion Architect to define and govern our modern lakehouse architecture. You’ll blend solution design, hands-on technical leadership, and platform enablement; setting patterns, accelerating delivery teams, and ensuring production-ready engineering on a contract basis. What you’ll do

  • Own end-to-end Databricks architecture across ingestion, transformation, governance, serving, and operations.
  • Set Medallion Architecture standards-Bronze/Silver/Gold, SCD/CDC, data quality, retention, performance.
  • Architect modern ingestion using AutoLoader, Lakeflow Connect, batch/streaming/CDC.
  • Lead Unity Catalog governance-namespace strategy, access models, lineage, secure-by-design patterns.
  • Define DLT with Expectations-quality rules, quarantine, observability.
  • Drive production-ready engineering-CI/CD, environments, monitoring, runbooks.
  • Align with security, EA, governance, platform and delivery teams.
  • Enable squads with playbooks, templates, ADRs, coaching.
  • Support pre-sales and roadmap-HLDs, estimation, risks, proposals.

Requirements

  • 2+ years recent hands-on Databricks experience using modern features.
  • Clear evidence of architecture ownership.

Must Have

  • Two active Databricks certifications (eg Data Engineer, ML, GenAI Engineer).
  • Proven Medallion Architecture design.
  • Unity Catalog architecture experience.
  • DLT with Expectations implementation.
  • Modern ingestion with AutoLoader/Lakeflow Connect.
  • Ability to articulate recent Databricks feature usage.

Should Have

  • Strong Delta Lake performance skills-MERGE/CDC, partitioning, OPTIMIZE/ZORDER, VACUUM.
  • Mature production architecture-Workflows, secrets, testing, observability.
  • Cloud integration (Azure/AWS/GCP).
  • Ability to standardise and influence across teams.

Nice to Have

  • Lakeflow connectors, RBAC/masking, GenAI (Mosaic AI, Vector Search, RAG), Lakebase.

About the company

City of London, Greater London, England - £500 - 650 per day Contract Posted by: IO Associates Posted: Thursday, 3 September 2026

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerboard.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:24 min

The governance failures of centralized data lakes

Mario Meir-Huber · LIVE

5:14 min

Executing Databricks jobs with built-in Airflow operators

Alan Mazankiewicz · LIVE

1:06 min

Outline of free tools for Microsoft Azure

Radu Vunvulea Radu Vunvulea · World Congress 2022

3:38 min

Architecting a unified data and machine learning workbench

Kapil Gupta Kapil Gupta · World Congress 2025

2:05 min

Enhancing Databricks tooling for software engineering workflows

Alan Mazankiewicz · LIVE

8:27 min

Building generic custom operators for Databricks APIs

Alan Mazankiewicz · LIVE

Videos

See all

Related articles

See all