AWS / Databricks Platform Engineer - Outside IR35
Shareforce Ltd
Charing Cross, United Kingdom
7 days ago
Role details
Contract type
Temporary contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
EnglishJob location
Remote
Charing Cross, United Kingdom
Tech stack
Artificial Intelligence
Amazon Web Services (AWS)
Data as a Services
Data Security
Github
Identity and Access Management
Network Security
OAuth
Role-Based Access Control
System Availability
Amazon Web Services (AWS)
Opsworks
Terraform
Databricks
Job description
We are seeking an experienced Platform Engineer to support the rollout and ongoing operation of a large-scale, federated Data and AI platform. The role will focus on building secure, scalable, and cost-optimised AWS infrastructure, implementing governance, and enabling advanced data services across multiple business domains., * Design, build, and maintain AWS infrastructure using Terraform (IaC).
- Develop, manage, and optimise CI/CD pipelines with GitHub Actions.
- Implement secure network connectivity using AWS PrivateLink (Interface VPC Endpoints) and VPC endpoint services.
- Configure and govern Databricks and Unity Catalog to ensure compliant data access and lineage.
- Enforce consistency and control through AWS Organizations, Service Control Policies (SCPs), AWS Config, and compliance frameworks.
- Manage identity and access management (IAM) using OAuth, federated credentials, and RBAC principles.
- Apply AWS security best practices, including Defense in Depth, BCDR, and high availability.
- Monitor and optimise cloud cost efficiency using AWS Cost Explorer, Budgets, and FinOps best practices.
- Collaborate with data, platform, and security teams to ensure a resilient, governed, and high-performing cloud ecosystem.
Requirements
- Proven experience delivering Terraform-based AWS infrastructure.
- Strong understanding of GitHub Actions and CI/CD automation.
- Hands-on expertise with AWS Private Link, VPC networking, and secure service exposure.
- Deep knowledge of Databricks and Unity Catalog for governance and security.
- Solid experience with AWS Organizations, SCPs, AWS Config, and resource governance.
- Background in AWS IAM, federated authentication, OAuth, and identity integration.
- Proven ability to design with security, resilience, and cost-optimisation in mind.
- Excellent collaboration and documentation skills within cross-functional teams