Databricks engineer

LA International
Wembley, UK
15 days ago
Apply on www.lainternational.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
2 years minimum
Working hours
Regular working hours

Tech stack

Amazon Web Services Audit Trail Microsoft Azure Identity and Access Management Python (Programming Language) Network Security Runbook SQL Databases Privacy Controls Data Lakes Terraform Databricks

Job description

We are looking for a Databricks engineer who can start a new assignment in the next couple of weeks. You will have at least 2 years of experience on Databricks and more than 6 years in data or platform engineering.

  • Architect and configure Databricks Clean Rooms (Delta Sharing-based) across clouds and workspaces, including cross-cloud and cross-region collaboration
  • Set up Unity Catalog metastores, catalogs, and sharing so only approved tables, views, and volumes enter each clean room
  • Build and approve clean room notebooks and queries (SQL, Python) for joint analytics, audience overlap, and ML scoring
  • Apply privacy controls: row filters, column masks, aggregation thresholds, and pseudonymisation or hashing of join keys
  • Define collaborator onboarding, output approval workflows, and revocation processes
  • Configure audit logging, lineage, and monitoring for every clean room run
  • Work with legal, privacy, and security teams to translate data-sharing agreements into technical controls
  • Produce architecture diagrams, runbooks, and reference patterns for reuse

Requirements

Strong Unity Catalog, Delta Lake, and Delta Sharing experience

  • Solid SQL and Python, plus Terraform or other infrastructure-as-code
  • Understanding of privacy-enhancing techniques and regulations (GDPR, UK GDPR, CCPA, sector rules)
  • Experience with IAM, network security, and audit on AWS or Azure

About the company

LA International is an award-winning partner of choice for many of the world’s most influential companies and government organisations. Holding Enhanced Government Security Accreditation, we are recognised as the European market leader in the delivery of Security Cleared talent to organisations that demand the very highest levels of security, compliance and assurance.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.lainternational.com
Prepare application

Good distractions

Loading talks and stories from around this role…