AWS / Databricks Platform Engineer - Outside IR35

Shareforce Ltd
Charing Cross, United Kingdom
7 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English

Job location

Remote
Charing Cross, United Kingdom

Tech stack

Artificial Intelligence
Amazon Web Services (AWS)
Data as a Services
Data Security
Github
Identity and Access Management
Network Security
OAuth
Role-Based Access Control
System Availability
Amazon Web Services (AWS)
Opsworks
Terraform
Databricks

Job description

We are seeking an experienced Platform Engineer to support the rollout and ongoing operation of a large-scale, federated Data and AI platform. The role will focus on building secure, scalable, and cost-optimised AWS infrastructure, implementing governance, and enabling advanced data services across multiple business domains., * Design, build, and maintain AWS infrastructure using Terraform (IaC).

  • Develop, manage, and optimise CI/CD pipelines with GitHub Actions.
  • Implement secure network connectivity using AWS PrivateLink (Interface VPC Endpoints) and VPC endpoint services.
  • Configure and govern Databricks and Unity Catalog to ensure compliant data access and lineage.
  • Enforce consistency and control through AWS Organizations, Service Control Policies (SCPs), AWS Config, and compliance frameworks.
  • Manage identity and access management (IAM) using OAuth, federated credentials, and RBAC principles.
  • Apply AWS security best practices, including Defense in Depth, BCDR, and high availability.
  • Monitor and optimise cloud cost efficiency using AWS Cost Explorer, Budgets, and FinOps best practices.
  • Collaborate with data, platform, and security teams to ensure a resilient, governed, and high-performing cloud ecosystem.

Requirements

  • Proven experience delivering Terraform-based AWS infrastructure.
  • Strong understanding of GitHub Actions and CI/CD automation.
  • Hands-on expertise with AWS Private Link, VPC networking, and secure service exposure.
  • Deep knowledge of Databricks and Unity Catalog for governance and security.
  • Solid experience with AWS Organizations, SCPs, AWS Config, and resource governance.
  • Background in AWS IAM, federated authentication, OAuth, and identity integration.
  • Proven ability to design with security, resilience, and cost-optimisation in mind.
  • Excellent collaboration and documentation skills within cross-functional teams

Apply for this position