> Markdown version of [/jobs/ext/103630-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/103630-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** WINSEARCH - **Location:** Gloucester, UK - **Experience:** Expert - **Salary:** £141,440.0 - **Contract:** Permanent contract - **Skills:** Amazon Web Services, Audit Trail, Microsoft Azure, Backup Devices, Batch Processing, Big Data, Continuous Integration, Data Architecture, Information Engineering, Data Retention, Data Security, Data Systems, DevOps, Disaster Recovery, Distributed Systems, Elasticsearch, Performance Tuning, Role-Based Access Control, Logstash, Data Processing, Data Ingestion, System Availability, Apache Spark, Git, Data Analytics, Apache Kafka, Apache Nifi, Data Management, Kibana, Stream Processing, Software Version Control, Data Pipelines, Docker - **Published:** May 21, 2026 - **Apply:** https://find.jobs/jobs-near-me/senior-data-engineer-gloucestershire/2780556213-2/ ## About the Role Strong hands-on experience with: * Elasticsearch * Logstash * Kibana * Apache NiFi - Proven experience designing and implementing enterprise-scale data pipelines - Background working within secure or regulated environments such as defence, government or finance - Strong understanding of: * Data ingestion and processing frameworks * Real-time and batch processing architectures * Data modelling for analytics * Distributed system troubleshooting and optimisation - Knowledge of: * Encryption and secure data handling * RBAC and audit controls * DevOps and CI/CD principles * Git/version control systems - Active DV Clearance essential - Sole British National essential DESIRABLE EXPERIENCE - AWS, Azure or GCP within secure environments - Docker and Kubernetes - Kafka, Spark or additional data engineering technologies ## Description We are recruiting on behalf of a highly secure engineering and technology programme seeking an experienced Senior Data Engineer to support the design, development and delivery of secure, scalable and high-performance data solutions within a regulated environment. This role will focus heavily on the Elastic Stack and Apache NiFi, supporting enterprise-scale data ingestion, transformation and analytics capabilities across complex secure systems. The successful candidate will play a key role in architecting resilient data platforms, optimising real-time and batch processing pipelines, and ensuring compliance with strict governance and security standards. KEY RESPONSIBILITIES Data Architecture & Engineering - Design and implement scalable, resilient data pipeline architectures using Elastic Stack and Apache NiFi - Develop secure frameworks for data ingestion, transformation and integration - Build and maintain batch and real-time data processing pipelines - Ensure high standards of data quality, integrity and traceability across all systems Elastic Stack & Platform Management - Configure, optimise and maintain Elasticsearch clusters for performance and resilience - Develop and maintain Logstash pipelines for efficient data processing - Create dashboards and visualisations within Kibana to support operational and strategic reporting - Monitor and manage large-scale data flows and platform performance in real time - Carry out troubleshooting, root cause analysis and performance tuning activities Security, Governance & Resilience - Work closely with security and governance teams to ensure compliance with stringent security standards - Implement secure data handling processes including encryption, RBAC and audit logging - Support clustering, replication and failover strategies to ensure system availability - Develop backup, disaster recovery and data retention strategies Documentation & Collaboration - Produce technical documentation covering architecture, workflows and security controls - Support knowledge transfer and operational handovers to internal teams ## Related Videos - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Debug a Kubernetes Operator](https://www.wearedevelopers.com/videos/487-debug-a-kubernetes-operator) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Add Location-based Searching to Site with ElasticSearch](https://www.wearedevelopers.com/videos/77-add-location-based-searching-to-site-with-elasticsearch) - [DevOps Maturity Check – a way to balance autonomy and alignment](https://www.wearedevelopers.com/videos/58-devops-maturity-check-a-way-to-balance-autonomy-and-alignment) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [Fullstack Developer Salary UK](https://www.wearedevelopers.com/magazine/251-fullstack-developer-salary-uk) - [Best Companies to work for in London: Top 25 Companies in 2023](https://www.wearedevelopers.com/magazine/187-best-companies-to-work-for-in-london-top-25-companies-in-2023) - [Software Engineer Salary in The UK](https://www.wearedevelopers.com/magazine/231-software-engineer-salary-in-the-uk)