SC Cleared Data Engineer - Databricks

iO Associates

Bristol, UK

about 1 month ago

Apply on www.totaljobs.com

Prepare application

Role details

Contract type

Temporary contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Compensation

£110,500.0 - £123,500.0

Working hours

Regular working hours

Job source

www.totaljobs.com

Tech stack

Continuous Integration Python (Programming Language) Apache Spark Data Pipelines Docker Databricks

Requirements

iO Associates are looking for an experienced SC Cleared Data Engineer with strong Azure Databricks expertise to join a Central Government team responsible for designing & developing high-volume datasets.

Essential Experience

Extensive hands-on experience with Azure Databricks
Recent experience working within UK Central Government
Strong Python development experience
Experience with Spark-based technologies
Experience building, automating and supporting data pipelines
Familiarity with CI/CD, Docker & Kubernetes

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.totaljobs.com

Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

Moments

Explore playlists

1:34 min

Bringing diverse skills to industrial data science roles

Katja Träumner

2:34 min

Capabilities of the Apache Spark processing engine

Ayon Roy · LIVE

2:27 min

Managing traffic and tracking costs with Databricks Unity Catalog

Viktoria Semaan · World Congress 2026 Europe

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz · World Congress 2025

1:59 min

Key takeaways and accessing the Databricks developer toolkit

Viktoria Semaan · World Congress 2026 Europe

1:41 min

Visualizing the complex developer journey for JVM ecosystems

Bobur Umurzokov · LIVE

Videos

See all

PySpark - Combining Machine Learning & Big Data thumbnail