> Markdown version of [/jobs/ext/2160198-lead-data-engineer](https://www.wearedevelopers.com/jobs/ext/2160198-lead-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Lead Data Engineer

- **Company:** Searchability
- **Location:** Gloucester, UK
- **Experience:** Expert
- **Salary:** £65,000.0 - £85,000.0
- **Contract:** Permanent contract
- **Skills:** Java (Programming Language), Apache HTTP Server, Acceptance Test-Driven Development, Databases, Information Engineering, Data Governance, Data Integration, Extract Transform Load (ETL), Groovy, Python (Programming Language), MongoDB, NoSQL, SQL Databases, Data Streaming, Systems Integration, Data Strategy, Apache Kafka, Apache Nifi, Data Pipelines
- **Published:** August 21, 2026
- **Apply:** https://www.adzuna.co.uk/jobs/details/5850892057

## About the Role

* Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL, Team Leadership, * Apache Kafka
 * Apache NiFI
 * SQL and NoSQL databases (e.g. MongoDB)
 * ETL processing languages such as Groovy, Python or Java
 * Understand and interpret technical and business stakeholder needs
 * Manage expectations through clear, proactive communication
 * Lead and support challenging conversations with teams and senior stakeholders, DATA ENGINEER / DATA ENGINEERING / DEFENCE / NATIONAL SECURITY / DATA STRATEGY / DATA PIPELINES / DATA GOVERNANCE / SQL / NOSQL / APACHE / NIFI / KAFKA / ETL / GLOUCESTER / DV / SECURITY CLEARED / DV CLEARANCE

## Description

* Design, build, and maintain data pipelines, including ingestion, orchestration, and enrichment
 * Develop data-streaming and ETL solutions (e.g. NiFi)
 * Model databases and integrate data from diverse sources
 * Ensure data quality, consistency, and security
 * Monitor and optimise system performance
 * Write clean, secure, reusable, test-driven code
 * Apply systems integration expertise within agile teams
 * Decompose user needs into epics and stories
 * Promote reuse of data flows and best practices across teams
 * Champion data engineering standards across government


## Related Videos

- [40 Minutes to Build a Serverless COVID-19 REST and GraphQL APIs](https://www.wearedevelopers.com/videos/208-40-minutes-to-build-a-serverless-covid-19-rest-and-graphql-apis)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Give your build some love, it will give it back!](https://www.wearedevelopers.com/videos/514-give-your-build-some-love-it-will-give-it-back)
- [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis)
- [NoSQL Data Modeling for Front-end Developers](https://www.wearedevelopers.com/videos/297-nosql-data-modeling-for-front-end-developers)
- [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)
- [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)