Python / Data Engineer
Spektrum
Mons, Belgium
2 days ago
Role details
Contract type
Contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
EnglishJob location
Mons, Belgium
Tech stack
Computing Platforms
Software Documentation
Data Architecture
Information Engineering
ETL
Database Queries
Python
Pcap
Linux Commands
MariaDB
MySQL
Query Optimization
Shell Script
SQL Databases
Data Streaming
Data Ingestion
Cyber Threat Analysis
GIT
REST
Software Version Control
Data Pipelines
Web Api
Job description
Design and implement data ingestion, processing, and dissemination pipelines for NATO cyber threat intelligence, using PyMISP, STIX/TAXII, and related technologies. Deliver the Data Dissemination Plan (D9) and supporting data engineering deliverables (D10-D14).
Role Duties and Responsibilities
- Design and implement PyMISP-based data ingestion and processing pipelines
- Develop STIX/TAXII feeds for inter-agency threat intelligence sharing
- Produce the Data Dissemination Plan (D9) in accordance with NCSC requirements
- Build data quality, validation, and enrichment layers for MISP event feeds
- Develop reporting dashboards and analytics outputs (D11-D14 per SOW scope)
- Work with Role 1 to ensure data architecture aligns with platform design
- Document all data flows, schemas, and pipeline components to NCIA standards
- Support NCSC analysts with data query optimisation and feed troubleshooting
Requirements
Do you have experience in Shell Scripting?, * Python development - production-grade scripted data pipelines
- PyMISP - direct experience with the PyMISP library and MISP data model
- Data pipeline design: ingestion, transformation, loading (ETL/ELT patterns)
- SQL and database querying (MySQL/MariaDB in MISP back-end context)
- STIX 2.x data format (Structured Threat Intelligence eXpression)
- TAXII (Trusted Automated eXchange of Indicator Information) server/client implementation
- REST API integration - consuming and producing API endpoints
- Data quality and validation frameworks in Python
- Linux command line - scripting and automation
- Version control (Git) and code documentation practices
Desirable
- Python Institute PCEP (Python Certified Entry Professional) minimum; PCAP preferred
- Any data engineering or pipeline certification acceptable as evidence (e.g. Google Professional Data Engineer)
Language Proficiency
- Fluent in English, * Valid National or NATO Secret personal security clearance
About the company
Spektrum supports apex purchasers (NATO, UN, EU, and National Government and Defence) and their Tier 1 supplier ecosystem with a wide range of specialist services. We provide our clients with professional services, specialised aerospace and defence sales, delivery, and operational subject matter expertise. We are looking for personnel to join our team and support key client projects., The NATO Communication and Information Agency (NCIA) is responsible for providing secure and effective communications and information technology (IT) services to NATO's member countries and its partners. The agency was established in 2012 and is headquartered in Brussels, Belgium.
The NCIA provides a wide range of services, including:
* Cyber Security: The NCIA provides advanced cybersecurity solutions to protect NATO's communication networks and information systems against cyber threats.
* Command and Control Systems: The NCIA develops and maintains the systems used by NATO's military commanders to plan and execute operations.
* Satellite Communications: The NCIA provides satellite communications services to enable secure and reliable communications between NATO forces.
* Electronic Warfare: The NCIA provides electronic warfare services to support NATO's mission to detect, deny, and defeat threats to its communication networks.
* Information Management: The NCIA manages NATO's information technology infrastructure, including its databases, applications, and servers.
Overall, the NCIA plays a critical role in ensuring the security and effectiveness of NATO's communication and information technology capabilities.
The program
Assistance and Advisory Service (AAS)
The NATO Communications and Information Agency (NCI Agency) is NATO's principal C3 capability deliverer and CIS service provider. It provides, maintains and defends the NATO enterprise-wide information technology infrastructure to enable Allies to consult together under Article IV, and, when required, stand together in the face of attack under Article V.
To provide these critical services, in the modern evolving dynamic environment the NCI Agency needs to build and maintain high performance-engaged workforce. The NCI Agency workforce strategically consists of three major categorise's: NATO International Civilians (NIC)'s, Military (Mil), and Interim Workforce Consultants (IWC)'s. The IWCs are a critical part of the overall NCI Agency workforce and make up approximately 15 percent of the total workforce.