3954 Senior Data Engineer

Data management

• Devises and implements master data management processes for specific subsets of data.
• Assesses the integrity of data from multiple sources.
• Provides advice on the transformation of data from one format/medium to another.
• Maintains and implements information handling procedures.
• Enables the availability, integrity and searchability of information through the application of formal data and metadata structures and protection measures.

Data modelling and design

• Applies standard data modelling and design techniques based upon a detailed understanding of requirements.
• Establishes, modifies and maintains data structures and associated components.
• Communicates the details of data structures and associated components to others using the data structures and associated components.

Data engineering

• Applies data engineering standards and tools to create and maintain data pipelines and extract, transform and load data.
• Carries out routine data quality checks and remediation.

• The candidate must have a currently active NATO SECRET security clearance
• The service contractor will be required to have a Bachelor of Science (BSc) degree at a nationally recognized/certified university in a technical subject with substantial Information Technology (IT) content and 3 years post-related experience. As an exception, the lack of a university degree may be compensated by the demonstration of a candidate’s particular abilities or experience that are of interest to the NCI Agency; namely, at least 5 years of extensive and progressive experience in the duties related to the functions of this post.
• The service contractor will be required to have strong technical depth in modern data engineering and platform integration.

The principal skill areas required are:

• Data engineering, including Python, Spark, Kafka, ETL/ELT pipelines, and automation
• Data modelling, ontology engineering, and semantic interoperability
• Metadata management and data governance
• Data quality frameworks and validation mechanisms
• Data platform integration and build/configuration practices
• Knowledge of federated data environments and, where possible, defense or mission-oriented data-sharing contexts.

Desirable:

• Prior experience of working in an international environment comprising both military and civilian elements.
• Knowledge of NATO organization, internal structure and resultant relationships.