Python / Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+10 more
Job description
Design and implement data ingestion, processing, and dissemination pipelines for NATO cyber threat intelligence, using PyMISP, STIX/TAXII, and related technologies. Deliver the Data Dissemination Plan (D9) and supporting data engineering deliverables (D10-D14).
Role Duties and Responsibilities
- Design and implement PyMISP-based data ingestion and processing pipelines
- Develop STIX/TAXII feeds for inter-agency threat intelligence sharing
- Produce the Data Dissemination Plan (D9) in accordance with NCSC requirements
- Build data quality, validation, and enrichment layers for MISP event feeds
- Develop reporting dashboards and analytics outputs (D11-D14 per SOW scope)
- Work with Role 1 to ensure data architecture aligns with platform design
- Document all data flows, schemas, and pipeline components to NCIA standards
- Support NCSC analysts with data query optimisation and feed troubleshooting
Requirements
Do you have experience in Shell Scripting?, * Python development - production-grade scripted data pipelines
- PyMISP - direct experience with the PyMISP library and MISP data model
- Data pipeline design: ingestion, transformation, loading (ETL/ELT patterns)
- SQL and database querying (MySQL/MariaDB in MISP back-end context)
- STIX 2.x data format (Structured Threat Intelligence eXpression)
- TAXII (Trusted Automated eXchange of Indicator Information) server/client implementation
- REST API integration - consuming and producing API endpoints
- Data quality and validation frameworks in Python
- Linux command line - scripting and automation
- Version control (Git) and code documentation practices
Desirable
- Python Institute PCEP (Python Certified Entry Professional) minimum; PCAP preferred
- Any data engineering or pipeline certification acceptable as evidence (e.g. Google Professional Data Engineer)
Language Proficiency
- Fluent in English, * Valid National or NATO Secret personal security clearance
About the company
Spektrum supports apex purchasers (NATO, UN, EU, and National Government and Defence) and their Tier 1 supplier ecosystem with a wide range of specialist services. We provide our clients with professional services, specialised aerospace and defence sales, delivery, and operational subject matter expertise. We are looking for personnel to join our team and support key client projects., The NATO Communication and Information Agency (NCIA) is responsible for providing secure and effective communications and information technology (IT) services to NATO’s member countries and its partners. The agency was established in 2012 and is headquartered in Brussels, Belgium.
The NCIA provides a wide range of services, including:
- Cyber Security: The NCIA provides advanced cybersecurity solutions to protect NATO’s communication networks and information systems against cyber threats.
- Command and Control Systems: The NCIA develops and maintains the systems used by NATO’s military commanders to plan and execute operations.
- Satellite Communications: The NCIA provides satellite communications services to enable secure and reliable communications between NATO forces.
- Electronic Warfare: The NCIA provides electronic warfare services to support NATO’s mission to detect, deny, and defeat threats to its communication networks.
- Information Management: The NCIA manages NATO’s information technology infrastructure, including its databases, applications, and servers.
Overall, the NCIA plays a critical role in ensuring the security and effectiveness of NATO’s communication and information technology capabilities.
The program
Assistance and Advisory Service (AAS)
The NATO Communications and Information Agency (NCI Agency) is NATO’s principal C3 capability deliverer and CIS service provider. It provides, maintains and defends the NATO enterprise-wide information technology infrastructure to enable Allies to consult together under Article IV, and, when required, stand together in the face of attack under Article V.
To provide these critical services, in the modern evolving dynamic environment the NCI Agency needs to build and maintain high performance-engaged workforce. The NCI Agency workforce strategically consists of three major categorise’s: NATO International Civilians (NIC)’s, Military (Mil), and Interim Workforce Consultants (IWC)’s. The IWCs are a critical part of the overall NCI Agency workforce and make up approximately 15 percent of the total workforce.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on indeed.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Data Engineer Salary UK
Dev Digest 138 - Are you secure about this?
Dev Digest 134 - Where pixels sing?
Dev Digest 121 - AI goes offline