Lead Data Engineer

• Design, build, and maintain data pipelines, including ingestion, orchestration, and enrichment
• Develop data-streaming and ETL solutions (e.g. NiFi)
• Model databases and integrate data from diverse sources
• Ensure data quality, consistency, and security
• Monitor and optimise system performance
• Write clean, secure, reusable, test-driven code
• Apply systems integration expertise within agile teams
• Decompose user needs into epics and stories
• Promote reuse of data flows and best practices across teams
• Champion data engineering standards across government

• Must hold active Enhanced DV Clearance (West)
• Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus
• Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL, Team Leadership, * Apache Kafka
• Apache NiFI
• SQL and NoSQL databases (e.g. MongoDB)
• ETL processing languages such as Groovy, Python or Java
• Understand and interpret technical and business stakeholder needs
• Manage expectations through clear, proactive communication
• Lead and support challenging conversations with teams and senior stakeholders, DATA ENGINEER / DATA ENGINEERING / DEFENCE / NATIONAL SECURITY / DATA STRATEGY / DATA PIPELINES / DATA GOVERNANCE / SQL / NOSQL / APACHE / NIFI / KAFKA / ETL / GLOUCESTER / DV / SECURITY CLEARED / DV CLEARANCE

Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You'll work with cutting-edge technologies, including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework and are set for significant growth.