Associate Data Fabric Engineer
Role details
Job location
Tech stack
Job description
As an Associate Data Fabric Engineer, you will further design, build and operate our secure, open, and extensible data fabric capability for Defence and National Security customers.
Day-to-day, you will create a shared "paved road" that lets teams integrate, govern, and consume data products both safely and quickly across batch, streaming and analyst-driven workflows. This includes enabling workflow automation and configurable data integration with resilient operation in Denied, Degraded, Intermittent and Limited (DDIL) communications environments supporting edge deployments.
Your responsibilities will include: Designing, implementing, and evolving the event-driven data fabric architecture that enables automation and downstream AI-based systems: ingestion, integration, storage, processing, metadata, governance, and access patterns aligned to customer outcomes and security constraints Supporting with building and operating workflow automation capabilities that enable repeatable, governed analyst workflows (reusable patterns, configuration-driven behaviours, and safe promotion across environments) Delivering configurable data integration through curated connectors and standard patterns for transformation, routing, enrichment and correlation with clear contract and operational guardrails Engineering for DDIL and edge deployments: Design Patterns for constrained connectivity, supporting appropriate local processing at edge and implementing secure configuration distribution Building streaming ingestion, event pipelines, batch/stream processing workloads using both distributed event streaming technologies and Apache Flink and/or Apache Spark with clear SLA's and repeatable deployment Implementing metadata, lineage and catalogue capabilities and implementing policy-based security and governance
Requirements
Do you have experience in Spark?, Previous experience as a data/platform engineer working on distributed systems in production Proven hands-on experience with open-source data integration and streaming technologies and delivering configurable integration patterns (connectors, reusable components, rules, and orchestration) Previous experience enabling workflow automation for technical users A strong grasp of data modelling fundamentals, data contracts and schema evolution Experience designing for reliability, scalability, and operability: monitoring, alerting, deployment automation, incident handling, and performance tuning A practical security mindset: least privilege, auditability and designing controls that do not restrict usability, We value difference and we don't have a fixed idea when it comes to background or education, provided you can show the required level of experience and willingness to learn then we would like to hear from you.
Benefits & conditions
Matched contribution pension scheme, with life assurance Generous holiday allowance, with the option to purchase additional days Options to join Health Cash Plan, Private Medical Insurance and Dental Insurance Employee discount portal: Personal Accident Insurance, Travel Insurance, Restaurants, Cinema Tickets and much more We are proud to support the Armed Forces community by honouring the Armed Forces Covenant and maintaining our Gold Award standard in the Defence Employer Recognition Scheme Volunteering Opportunities - helping charities and local community
Our Recruitment Process: We want to make sure that our recruitment process is as inclusive as possible and we aspire to bring out the best in our candidates by creating an environment where everyone feels value, heard and supported. If you have a disability or health condition that may affect your performance in certain assessment types, please speak to your Recruiter about potential reasonable adjustments.