Lead Data Engineer

Searchability

Gloucester, UK

11 days ago

Apply on www.adzuna.co.uk

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Compensation

£65,000.0 - £85,000.0

Working hours

Regular working hours

Job source

www.adzuna.co.uk

Tech stack

Java (Programming Language) Apache HTTP Server Acceptance Test-Driven Development Databases Information Engineering Data Governance Data Integration Extract Transform Load (ETL) Groovy Python (Programming Language) MongoDB NoSQL

+7 more

SQL Databases Data Streaming Systems Integration Data Strategy Apache Kafka Apache Nifi Data Pipelines

Job description

Design, build, and maintain data pipelines, including ingestion, orchestration, and enrichment
Develop data-streaming and ETL solutions (e.g. NiFi)
Model databases and integrate data from diverse sources
Ensure data quality, consistency, and security
Monitor and optimise system performance
Write clean, secure, reusable, test-driven code
Apply systems integration expertise within agile teams
Decompose user needs into epics and stories
Promote reuse of data flows and best practices across teams
Champion data engineering standards across government

Requirements

Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL, Team Leadership, * Apache Kafka
Apache NiFI
SQL and NoSQL databases (e.g. MongoDB)
ETL processing languages such as Groovy, Python or Java
Understand and interpret technical and business stakeholder needs
Manage expectations through clear, proactive communication
Lead and support challenging conversations with teams and senior stakeholders, DATA ENGINEER / DATA ENGINEERING / DEFENCE / NATIONAL SECURITY / DATA STRATEGY / DATA PIPELINES / DATA GOVERNANCE / SQL / NOSQL / APACHE / NIFI / KAFKA / ETL / GLOUCESTER / DV / SECURITY CLEARED / DV CLEARANCE

About the company

Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You’ll work with cutting-edge technologies, including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework and are set for significant growth.