DV Cleared Data Pipeline Developer
Role details
Job location
Tech stack
Job description
We are seeking an experienced DV Cleared Data Pipeline Developer to support a large UK Central Government department on a long-term, high-assurance programme. This engagement is Outside IR35, operating on a project-based delivery model with a clear statement of work and deliverables., You will be responsible for the design, build, and delivery of secure data pipelines and orchestration platforms within a highly classified environment. The role focuses on outcomes and technical delivery rather than headcount substitution, aligning with Outside IR35 status., * Designing, building, and delivering data pipelines and orchestration workflows using Prefect or Airflow
- Developing Python-based services and APIs for data ingestion and enrichment
- Building and deploying containerised workloads using Docker and Kubernetes (or Swarm)
- Managing dependencies and build pipelines in air-gapped environments with no internet access
- Implementing and maintaining data governance and secure data handling practices
- Automating and configuring business workflow tooling, including Jira-based processes
- Working with Elastic, MongoDB, Cassandra, Redis, and S3-compatible storage
- Producing technical documentation and delivering agreed outcomes against the statement of work
- Collaborating with platform, DevOps, and security teams while retaining autonomy over technical approach
Requirements
Essential experience:
- Active UKSV DV clearance (minimum 12 months remaining)
- Strong Python development experience in secure or restricted environments
- Proven delivery of data pipelines using Prefect or Airflow
- Hands-on experience with Docker, Kubernetes, and container orchestration
- Experience operating in air-gapped systems, managing builds without external connectivity
- Strong understanding of data governance, security, and compliance
- Experience building APIs for data services
- Confident working 5 days per week onsite in secure locations (Vauxhall / Stratford)
- Comfortable delivering against clearly defined outcomes, consistent with Outside IR35 engagements, * Experience with AI / ML, including PyTorch, NLP, or LLMs
- Advanced data handling and large-scale processing experience
- Familiarity with the Atlassian Suite (Jira, Confluence)
- Experience using GitHub in mirrored or restricted environments
- Strong Linux CLI skills