Security Cleared Databricks Engineer (AWS) - Remote
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+2 more
Job description
We’re supporting a market-leading Databricks consultancy and one of the UK’s most established Databricks Partners in the search for an experienced Security Cleared Databricks Engineer to join a high-profile client engagement.
This is an opportunity to play a key role in designing, securing, automating, and governing a large-scale Databricks platform hosted on AWS, whilst acting as the platform SME across architecture, engineering, and delivery teams., Databricks Platform Engineering & Administration:
- Design, administer, and optimise Databricks environments across workspace and account levels.
- Own and manage Databricks permissions, including Unity Catalog, identity management, access controls, groups, and governance.
- Design and implement secure networking architectures for Databricks on AWS, including private connectivity and network isolation.
- Support platform infrastructure design, deployment, and operational management.
- Design, document, and implement disaster recovery strategies and recovery planning.
- Stay current with the Databricks product roadmap and advise stakeholders on new capabilities and best practices.
Architecture & Advisory:
- Act as the primary Databricks SME for client architecture, engineering, and delivery teams.
- Lead solution and data architecture activities from discovery through to design and implementation.
- Assess proposed platform changes for risk, impact, scalability, and security considerations.
- Support release planning and release management activities.
Automation & DevOps:
- Develop and maintain infrastructure-as-code using Terraform.
- Build and manage GitHub-based CI/CD pipelines for infrastructure and engineering deployments.
- Ensure all platform changes are version-controlled, repeatable, and properly governed.
- Produce and maintain platform documentation within Jira, Confluence, and the wider Atlassian suite.
Client Enablement:
- Deliver knowledge transfer sessions and technical training to client platform teams.
- Communicate complex concepts including networking, permissions, governance, and disaster recovery to both technical and non-technical stakeholders.
- Create documentation and operational processes that enable long-term client ownership of the platform.
Requirements
Active SC Clearance
Strong commercial experience with Databricks on AWS
Deep understanding of:
- Unity Catalog
- Workspace and account administration
- Identity and access management
- Permissions and governance models
AWS networking expertise, including:
- Private networking
- Secure connectivity
- Network isolation
Terraform and Infrastructure as Code
GitHub Actions / CI/CD Pipelines
Disaster Recovery planning and implementation
Strong architecture and consultancy experience
Excellent stakeholder management and communication skills, * data
- data engineer
- devops
- azure
- aws
- platform engineer
- MS Business Intelligence
- databricks
About the company
Tenth Revolution Group are the go-to recruiter for Data & AI roles in the UK offering more opportunities across the country than any other recruitment agency. We’re the proud sponsor and supporter of SQLBits, Power Platform World Tour, and the London Fabric User Group. We are the global leaders in Data & AI recruitment.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…