Security Cleared Databricks Engineer (AWS) - Remote

Tenth Revolution Group
London, United Kingdom
1 day ago
Apply on www.reed.co.uk
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
6 years minimum
Compensation
£130,000
Working hours
Regular working hours
Job source

Tech stack

Amazon Web Services Confluence JIRA Data Architecture DevOps Disaster Recovery Github Identity and Access Management Network Security Release Management SC Clearance Atlassian Tools
+2 more
Terraform Databricks

Job description

We’re supporting a market-leading Databricks consultancy and one of the UK’s most established Databricks Partners in the search for an experienced Security Cleared Databricks Engineer to join a high-profile client engagement.

This is an opportunity to play a key role in designing, securing, automating, and governing a large-scale Databricks platform hosted on AWS, whilst acting as the platform SME across architecture, engineering, and delivery teams., Databricks Platform Engineering & Administration:

  • Design, administer, and optimise Databricks environments across workspace and account levels.
  • Own and manage Databricks permissions, including Unity Catalog, identity management, access controls, groups, and governance.
  • Design and implement secure networking architectures for Databricks on AWS, including private connectivity and network isolation.
  • Support platform infrastructure design, deployment, and operational management.
  • Design, document, and implement disaster recovery strategies and recovery planning.
  • Stay current with the Databricks product roadmap and advise stakeholders on new capabilities and best practices.

Architecture & Advisory:

  • Act as the primary Databricks SME for client architecture, engineering, and delivery teams.
  • Lead solution and data architecture activities from discovery through to design and implementation.
  • Assess proposed platform changes for risk, impact, scalability, and security considerations.
  • Support release planning and release management activities.

Automation & DevOps:

  • Develop and maintain infrastructure-as-code using Terraform.
  • Build and manage GitHub-based CI/CD pipelines for infrastructure and engineering deployments.
  • Ensure all platform changes are version-controlled, repeatable, and properly governed.
  • Produce and maintain platform documentation within Jira, Confluence, and the wider Atlassian suite.

Client Enablement:

  • Deliver knowledge transfer sessions and technical training to client platform teams.
  • Communicate complex concepts including networking, permissions, governance, and disaster recovery to both technical and non-technical stakeholders.
  • Create documentation and operational processes that enable long-term client ownership of the platform.

Requirements

Active SC Clearance

Strong commercial experience with Databricks on AWS

Deep understanding of:

  • Unity Catalog
  • Workspace and account administration
  • Identity and access management
  • Permissions and governance models

AWS networking expertise, including:

  • Private networking
  • Secure connectivity
  • Network isolation

Terraform and Infrastructure as Code

GitHub Actions / CI/CD Pipelines

Disaster Recovery planning and implementation

Strong architecture and consultancy experience

Excellent stakeholder management and communication skills, * data

  • data engineer
  • devops
  • azure
  • aws
  • platform engineer
  • MS Business Intelligence
  • databricks

About the company

Tenth Revolution Group are the go-to recruiter for Data & AI roles in the UK offering more opportunities across the country than any other recruitment agency. We’re the proud sponsor and supporter of SQLBits, Power Platform World Tour, and the London Fabric User Group. We are the global leaders in Data & AI recruitment.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.reed.co.uk
Prepare application

Good distractions

Loading talks and stories from around this role…