Lead Data Platform Engineer

Digital Skills Ltd

2 days ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Working hours

Regular working hours

Languages

English

Experience level

Senior

Compensation

£ 110K

Job location

Remote

Tech stack

Clean Code Principles

Java

Agile Methodologies

Amazon Web Services (AWS)

Continuous Integration

Data Infrastructure

DevOps

Elasticsearch

Python

PostgreSQL

Redis

Ansible

Solr

Data Streaming

Systems Integration

Test Driven Development

Spark

Spring-boot

Event Driven Architecture

Apache Flink

Real Time Data

Kafka

Video Streaming

Terraform

Data Pipelines

Jenkins

Job description

As a Lead Data Platform Engineer, you will design and deliver batch and Real Time data pipelines that are highly available, low-latency, and scalable.

You will collaborate with cross-functional teams to shape solutions, influence architecture, and ensure data is transformed into reliable, consumable outputs., * Design, build, and deploy data pipelines and Back End services

Work with Real Time streaming technologies and event-driven architectures
Champion engineering best practices including TDD, CI/CD, and clean code
Collaborate with architects, analysts, and testers in Agile/BDD environments
Take ownership of services in production, ensuring performance and reliability
Drive continuous improvement across data platform capabilities
Contribute to solution design, estimation, and delivery planning

Requirements

Strong production Java experience
Experience with Kafka, Kinesis, or similar streaming technologies
Hands-on experience with Spark, Flink, Kafka Streams, or similar
Experience with Spring Boot and/or Python
Strong experience with AWS (including Lambda and S3)
Experience integrating with PostgreSQL, Redis, or similar
Solid understanding of data pipelines and data modelling
Passion for clean, testable, and maintainable code
Experience working in Agile and/or DevOps environments

Desirable Skills

Experience with Elasticsearch, OpenSearch, or Solr
Familiarity with Terraform, Ansible, or Packer
Experience with CI/CD tools such as Jenkins or Drone

Benefits & conditions

Remote - United Kingdom - £100k - £110k PA + benefits Full Time Posted by: Digital Skills Ltd Posted: Tuesday, 31 March 2026 Applicants must be eligible to work in the specified location

Lead Data Platform Engineer