Machine Learning Operations Engineer

Deloitte
Birmingham, UK
3 days ago
Apply on apply.deloitte.co.uk
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
4 years minimum
Working hours
Regular working hours

Tech stack

AI Evaluation Artificial Intelligence Amazon Web Services Confluence Continuous Integration Monitoring of Systems Python (Programming Language) Machine Learning Systems Development Life Cycle Reference Data Microsoft Copilot Search Technologies
+15 more
Enterprise Data Management Large Language Models Snowflake Multi-Agent Systems Generative AI Kubernetes Real-time Inference Bitbucket Machine Learning Operations Virtual Agents Graph RAG Splunk Network Server Databricks Agent2Agent Protocol

Job description

We are looking for an experienced Machine Learning Operations Engineer to help design, build and deploy enterprise AI and Copilot solutions for one of our Financial Services clients. You will work across machine learning, retrieval-augmented generation (RAG), agent orchestration and cloud platforms to deliver scalable, production-grade AI capabilities. The role requires hands-on experience building ML pipelines, deploying models into production, integrating enterprise data sources and implementing robust governance, monitoring and evaluation frameworks. Preferably someone from a Financial Services background.

Responsibilities but not limited to;

  1. Design and ship production Copilot agents, owning them from prototype through production
  2. Build retrieval that holds up in production: Graph RAG combining knowledge-graph traversal over accounts, contacts, products, and prior engagements with vector search,
  3. Design agent memory: episodic and semantic memory organized as memory nodes, with recall, summarization, and decay policies tuned per use case,
  4. Own organizational context management
  5. Build and productionize ML model training pipelines
  6. Build batch and online inference for those models
  7. Own answer quality as an engineering discipline
  8. Compose multi-agent workflows using A2A, and integrate tools and data through MCP servers (CRM, client and product reference data, document stores, calendar and email, Databricks, Snowflake, Kubernetes, Confluence, Bitbucket, Splunk).
  9. Build and run evals: task-level and end-to-end agent evaluations, regression suites, LLM-as-judge, human review loops with sellers, and quality and safety gating before release.
  10. Close the loop with production feedback
  11. Produce the model documentation, test evidence and controls
  12. Deploy and operate solutions on public cloud (AWS) with strong SDLC, security, resiliency, and observability practices.
  13. Partner with sales, coverage, product and business partners to turn use cases into shipped, supported agents., 1. Design, build and own production-grade copilot agents that provide secure, context-aware and persistent support across the client relationship.
  14. Deliver production ML and retrieval capabilities that turn enterprise data into timely, explainable recommendations for sellers.
  15. Establish the evaluation, governance and operational controls required for trusted AI at enterprise scale.

Requirements

  • 4 years experience building Copilot or AI agent solutions preferably from a Financial Services background

  • 4 years experience building and deploying machine learning models in production environments.

  • Experience working with AWS cloud platforms.
  • Expertise in ML Ops practices, CI/CD, model monitoring and lifecycle management.
  • Experience with Generative AI, LLMs and Retrieval-Augmented Generation (RAG) architectures.
  • Strong Python development skills and experience with Databricks.
  • Experience developing batch and real-time inference pipelines.
  • Knowledge of vector search, retrieval optimisation and AI evaluation frameworks.
  • Experience of Graph RAG and MCP integrations.
  • Familiarity with Kubernetes, Snowflake and enterprise data integrations.
  • Strong understanding of security, observability and AI governance principles.
  • Excellent stakeholder management and communication skills

About the company

As a means of managing tax, commercial and reputational risks, Deloitte prohibits the use of Associates through Personal Service Companies (‘PSCs’). All Associates must contract under PAYE arrangements through a Deloitte approved ‘Employment Company’ (aka ‘umbrella company.’)

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on apply.deloitte.co.uk
Prepare application

Good distractions

Loading talks and stories from around this role…