Senior Data Engineer - Warminster (Hybrid working) - £80 - £95K + Benefits

Senior Data Engineer - Warminster (Hybrid working) - £80 - £95K - Must be eligible for SC Clearance.

The Role

We're looking for a Senior Data Engineer to help design and build the data backbone of a major, multi-year UK Ministry of Defence programme - one of the most significant training transformation efforts in UK defence today.

In this role, you'll shape how training, exercise and partner data flows across complex systems: from ingest and modelling through to storage, reporting and integration with the platforms our customers rely on every day.

This is a senior engineering role with real ownership and close proximity to delivery. You'll independently lead substantial pieces of work end-to-end - designing pipelines, modelling data, selecting the right architectural patterns, and taking solutions through to production.

Alongside delivery, you'll help shape how the wider team approaches data engineering: influencing standards, tooling, testing, observability and operational practices.

You'll work closely with engineers, project managers and designers within the programme team, alongside senior customer stakeholders and peers across the wider engineering organisation - where the individual contributor path is valued equally alongside management.

What You'll Do

• Design, build and operate batch and streaming data pipelines that move training and exercise data between MoD systems and partner platforms - with reliability, observability and security considered from day one.
• Lead data modelling and warehouse/lakehouse design decisions, balancing long-term maintainability with the realities of a complex multi-year delivery.
• Work primarily across the Microsoft/Azure data stack, including SQL Server, Azure Data Factory, Synapse/Fabric and Power BI, while using tools such as Python, dbt and Airflow where appropriate.
• Introduce event-driven and CDC patterns using technologies such as Kafka and Event Hubs to support near Real Time data movement across systems.
• Help raise engineering standards around code quality, testing, observability and operability - treating data as a first-class engineering concern.
• Mentor and coach engineers across the team and help grow data engineering as a discipline within the organisation.
• Partner with project managers and designers to ensure the data solutions we build genuinely support end users and operational outcomes.

About You

You're an experienced data engineer who has independently delivered substantial pipeline, modelling or platform work from design through to production - and you still enjoy being hands-on with the code.

You'll likely bring:

• Strong SQL skills and experience with at least one transformation language or framework - Python is common for us, but we're flexible.
• Experience working with version control, code review and testing practices for data engineering.
• Familiarity with the Microsoft/Azure data ecosystem, including SQL Server, Data Factory, Synapse or Fabric, and Power BI.
• Good judgement around data modelling and warehouse/lakehouse architecture, with a practical understanding of when to use batch versus streaming or event-driven approaches.
• A pragmatic mindset around quality and operations - you care about how systems behave in production as much as how they look in code review.
• Strong collaboration skills and experience working with engineers, project managers, designers and senior customer stakeholders, including within regulated environments.
• A mentoring mindset and a genuine interest in helping others improve.
• Eligibility for UK Security Clearance (SC). Existing SC clearance is a plus, but we're equally happy to hear from candidates willing and eligible to undergo clearance.
• A genuine interest in our mission: building software that helps armed forces, public safety and resilience organisations train, prepare and respond effectively.

This is an excellent opportunity to join an exciting company that can offer career development. For more information a a full job description, please contact Ben Turner at BRT Consulting.

You're an experienced data engineer who has independently delivered substantial pipeline, modelling or platform work from design through to production - and you still enjoy being hands-on with the code., * Strong SQL skills and experience with at least one transformation language or framework - Python is common for us, but we're flexible.

• Experience working with version control, code review and testing practices for data engineering.
• Familiarity with the Microsoft/Azure data ecosystem, including SQL Server, Data Factory, Synapse or Fabric, and Power BI.
• Good judgement around data modelling and warehouse/lakehouse architecture, with a practical understanding of when to use batch versus streaming or event-driven approaches.
• A pragmatic mindset around quality and operations - you care about how systems behave in production as much as how they look in code review.
• Strong collaboration skills and experience working with engineers, project managers, designers and senior customer stakeholders, including within regulated environments.
• A mentoring mindset and a genuine interest in helping others improve.
• Eligibility for UK Security Clearance (SC). Existing SC clearance is a plus, but we're equally happy to hear from candidates willing and eligible to undergo clearance.
• A genuine interest in our mission: building software that helps armed forces, public safety and resilience organisations train, prepare and respond effectively.