Senior Data Engineer

Searchability

Portsmouth, UK

6 days ago

Apply on www.collegerecruiter.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Compensation

£90,000.0

Working hours

Regular working hours

Job source

www.collegerecruiter.com

Tech stack

Airflow Cloud Computing Continuous Integration Data Infrastructure Distributed Data Store Python (Programming Language) PostgreSQL Machine Learning Ansible Software Engineering Workflow Management Systems Data Processing

+8 more

Apache Spark Kubernetes Infrastructure Automation Frameworks Apache Kafka Machine Learning Operations Terraform Data Pipelines Docker

Requirements

Strong Python development and software engineering experience
Experience building scalable data pipelines and distributed data platforms
Knowledge of Kafka, Spark and modern data processing technologies
Experience with orchestration tools such as Airflow, Dagster or Prefect
Hands-on experience with Docker, Kubernetes and containerised deployments
CI/CD experience with a focus on production ownership and reliability
Understanding of data quality, testing and lineage best practices
MLOps or production machine learning experience
Terraform, Ansible or other Infrastructure as Code tools
PostgreSQL and modern data platforms
Experience within Defence, National Security or regulated environments
Familiarity with air-gapped, restricted or secure networks
Knowledge of Google Distributed Cloud (GDC) or edge cloud technologies

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.collegerecruiter.com

Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

Moments

Explore playlists

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon · World Congress 2026 Europe

2:57 min

Core technical practices for robust data engineering

Sandhya Menon · World Congress 2026 Europe

1:42 min

Automating Skupper deployments using Ansible

Alex Soto · World Congress 2024

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz · World Congress 2025

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy · World Congress 2024

Videos

See all

From Messy Queries to Scalable Systems - How Data Engineering actually works thumbnail