SC Cleared Databricks Architect | Remote
SR2
London, United Kingdom
2 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.constructionjobboard.co.uk
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source
Tech stack
Amazon Web Services
Computing Platforms
Information Engineering
Data Security
Data Sharing
Identity and Access Management
Metadata
Network Service
Data Mesh
Systems Integration
Apache Spark
SC Clearance
+5 more
Data Lakes
Deployment Automation
Data Management
Terraform
Databricks
Job description
You’ll help shape an enterprise Databricks environment on AWS, supporting secure platform foundations and trusted, reusable data products. Working with engineering, governance and business teams, you’ll define architecture that enables teams to discover, access and use data effectively., * Define architecture, reference designs and reusable patterns for Databricks platforms and data products.
- Shape AWS platform foundations, integration approaches and processing patterns for batch and streaming workloads.
- Establish standards for data modelling, data contracts, metadata, quality and product lifecycle management.
- Design governance and access controls through Unity Catalog, supporting discovery, lineage and secure data sharing.
- Guide performance, reliability and cost decisions across platform services and data workloads.
- Lead design reviews and stakeholder workshops, providing technical assurance and direction to delivery teams.
Requirements
- Strong architecture experience delivering enterprise Databricks and Lakehouse solutions.
- Expertise in Delta Lake, Unity Catalog and modern data engineering patterns.
- Experience integrating Databricks with AWS, including relevant storage, identity and networking services.
- A strong background in either:
- Platform architecture: AWS infrastructure, medallion architecture, compute, orchestration, Terraform and deployment automation.
- Data product architecture: reusable data products, data contracts, modelling, metadata, governance and self-service consumption.
- Understanding of security, access management and governance within complex organisations.
- Ability to communicate architecture decisions clearly and guide multidisciplinary teams.
- SC clearance required.
Desirable
- Knowledge of Spark, dbt, Databricks SQL or Workflows.
- Experience applying data mesh principles and enabling governed data sharing.
- Relevant Databricks, AWS, Terraform or data management certifications.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.constructionjobboard.co.uk
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…