Data Lead
Role details
Job location
Tech stack
Job description
report operationally through OMNIA Training and functionally through the Chief Engineer. Ultimately, you'll work for the British Army, championing innovation, and helping shape the future of military collective training.Key ResponsibilitiesCollaborate with engineering, simulation, customer, third party and training teams to align data solutions with business needs.Provide oversight and advice to engineers undertaking the design of data models and support the management of data dictionaries.Ensure the security and compliance of data environments through the implementation of appropriate architecture principles, security controls and governance frameworks.Author, review and contribute to technical documentation.Assist in the architect, design, and implementation of scalable, high-performance data platforms and pipelines.Continuously improve data systems through profiling, testing, and automation.Define and enforce data engineering standards and best practices including data lifecycle design, As our Spatial Data Subject Matter Expert, you will be responsible to the Data Lead and form part of the OMNIA Data Team consisting of Data Analysts and Engineers. Is your CV ready If so, and you are confident this is the role for you, make sure to apply asap. The..., Key Responsibilities: Lead the design and delivery of end-to-end AI/ML solutions aligned to organisational strategy and operational objectives. Define scalable, secure, and maintainable AI architectures, covering data pipelines, model lifecycle management, deployment, and..., A leading global real estate services firm is seeking a Data Centre Shift Engineer to provide Risk Mitigation for critical building systems. You will perform preventive maintenance and ensure all mechanical and electrical systems are operational. Qualified candidates should..., Function: EngineeringDuration: PermanentHours: Full Time (37 hours per week)Location(s): Warminster Design our scalable, secure and cost-effective cloud hybrid data solution aligned with Omnia enterprise architecture and Army training objectives. Design innovative data..., Key Responsibilities: - Lead the design and delivery of end-to-end AI/ML solutions aligned to organisational strategy and operational objectives. - Define scalable, secure, and maintainable AI architectures, covering data pipelines, model lifecycle management, deployment,...
Requirements
transformation and management.Produce High- and low-level design artifacts for data storage, processing, and retrieval systems.Stay current with data technologies, making recommendations for use based on business value. Drive the adoption of these technologies.Serve as the Subject Matter Expert (SME) for the Omnia Data Lakehouse, providing strategic guidance, technical oversight, and deep expertise in its architecture, implementation, and optimisation.Collaborate, design and review with stakeholders the data required for ingestion into the data lake.Collaborate, assist in the design and review with stakeholders for analytics / dashboards to drive business value from the Omnia data lake.Who we are looking forYou'll have a mission focus, and the enthusiasm and drive to 'get things done'. You'll want to work in collaboration with other defence training organisations, and the British Army. You won't let bureaucracy get in the way of what needs to be done, you'll learn lessons and share these lessons across the team. You'll understand what it means to put the mission first.The ideal candidate will provide hands-on technical oversight and management across the Army Collective Training Service (ACTS) data solutions. They will work with the Enterprise Architect to support the design and maintenance of a robust enterprise data architecture that supports the ACTS vision and promotes data as a strategic asset. Data is predominantly MODCloud hosted utilising Cloud Services from AWS, Azure, OCP where appropriate. You will play a critical role in enforcing data architecture principles and ensuring the appropriate transformation, assurance and delivery of data across ACTS services and capabilities to the point of need. This includes the integration and effective use of data from legacy sources via APIs.This role requires a systems-thinking mindset, strong stakeholder engagement skills, and the ability to work across engineering teams in a complex and evolving environment. Given the programme's focus on modelling and simulation, familiarity with relevant standards and technologies is desirable.Essential Skills and ExperienceHands-on experience with cloud platforms (AWS, Azure, GCP, OCI) and cloud-native data services including use of services like S3, Lambda, Glue, Data Factory, etc.Experience designing and building large-scale data pipelines, data warehousing and Lakehouse technologies.Strong expertise in SQL for data querying, transformation, and optimisation.Proficiency in distributed data processing frameworks (e.g., Spark, Flink, Hadoop).Previous experience with Python, Java for data engineering.Hands-on experience with data orchestration and workflow management tools (e.g., Airflow, Dagster, Prefect).Experience with API management and gateway tools and services.Experience of RESTful APIs for ingesting and exposing data.Proven track record with data governance, quality, lineage, and security practices.Experience with real-time/streaming data technologies, data Ingestion / ETL (e.g., Apache Kafka, Apache Ni Fi, Kinesis, Pub/Sub).Experience in, or knowledge of, Dev Sec Ops Tooling and ProcessesStrong strategic business acumen and understanding of business strategy and the ability to identify Solutions to deliver that strategySelf-starter with the ability to appropriately prioritise and plan complex work in a rapidly changing environmentStrong critical thinker with problem solving aptitudeA working knowledge of Mo D or Government IT Security environments and requirements at various classifications.Holder of current SC clearance, or the ability to gainDesirable Skills and ExperienceMSc in Data Engineering or equivalent professional accreditation such as CEng.Experience with graph databases and advanced query languages (e.g., Neo4j, Gremlin).Knowledge of machine learning data pipelines and MLOps practices.Familiarity with data virtualisation and data mesh concepts.Hands-on experience with containerisation and orchestration (Docker, Kubernetes, Red Hat Open Shift and Ceph).Exposure to infrastructure-as-code tools (Terraform, Cloud Formation).Experience with BI/visualisation tools (e.g., Tableau, Power BI, Looker, Elastic Stack).Knowledge of compliance frameworks (GDPR, HIPAA, CCPA) and their impact on data systems.Strong background in performance tuning for high-throughput, low-latency data systems.Microsoft Certified: Azure Data Engineer Associate, AWS Certified Data Engineer, IBM Data Engineering Professional Certificate or similar.Formal offers to successful candidates will be conditional upon award expected December 2025*What we offerBe Part of a Groundbreaking Mission Join the UK's most advanced defence training alliance, where industry experts converge to push boundaries and deliver excellence.A Culture Built on Collaboration Work in an inclusive, high-performing team that celebrates ideas, supports growth, and is laser-focused on
Benefits & conditions
delivering results.Team dynamics You will be part of a team that works together, across multiple organisations united in one mission.Work Across Borders, United in Purpose Operate across organisations with one shared goal - improving capability across all domains.Drive Innovation Your voice matters. We champion new ideas, welcome change, and believe in continuous improvement with a growth mind-set.Shape the Future Play a crucial role in a long-term, future-facing programme with real-world impact on national defence.Career Growth & Benefits Enjoy a strong benefits package, ongoing development opportunities, and clear pathways to progress within a trusted defence industry partner.OMNIA® Training and its partners are proud to be an equal opportunity employer. We welcome applicants of all backgrounds and identities - what matters is your passion, your expertise, and your dedication to the mission. The company adheres to equal employment principles. All