> Markdown version of [/jobs/ext/3563302-software-engineer-ml-infrastructure-london](https://www.wearedevelopers.com/jobs/ext/3563302-software-engineer-ml-infrastructure-london). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Software Engineer (ML Infrastructure), London

- **Company:** Artificial Intelligence
- **Location:** London, UK
- **Contract:** Permanent contract
- **Skills:** Computer-Aided Design, Application Programming Interfaces (APIs), Concurrent Computing, Continuous Delivery, Continuous Integration, Distributed Systems, Python (Programming Language), Machine Learning, Kubernetes, Azure AKS, Machine Learning Operations
- **Published:** October 3, 2026
- **Apply:** https://find.jobs/jobs-near-me/apply/ats-redirect/?id=2998718693-2

## About the Role

* Experience writing and maintaining Python code in production environments, with an emphasis on concurrent programming (with a strong knowledge of async, threads, processes, GIL, etc).
 * Experience building, maintaining and operating Kubernetes services.
 * Experience working with distributed systems.
 * Experience maintaining APIs that serve a moderately large set of internal users.
 * Experience working with ML models; an understanding of ML lifecycle and how serving and operating ML models differs from other kinds of workloads., * Experience working on an inference platform.
 * Experience managing a fleet of ML models.
 * Experience building and maintaining CI/CD processes for complex systems.
 * Experience with GCP or other comparable clouds.
 * Experience with building internal and user-focused dashboards.

## Description

* Sector: Science & Technology, Education - Excluding Post Secondary, Education - Post Secondary, Energy/Power, Facility Maintenance, Graphic Design/CAD, Healthcare - Allied Health, Healthcare - Dental Care, Healthcare - Nursing, Healthcare - Physician, Interior Design/Decorating, Law Enforcement, Social Services/Counseling, Veterinary Services, This is a great opportunity to play a defining role in building and operating our inference platform. You will connect deep expertise in distributed systems programming with hands-on knowledge of operating Kubernetes-based platforms according to best practices, all while supporting the platform in production. You will be instrumental in serving cutting-edge machine-learning models at massive scale for scientific applications, often requiring you to think from first principles. Success in this role demands excellent technical skills, independence, strong ownership, and a relentless user-focus.

What you will do

 * Contribute to the development and operation of the inference platform, serving fleets of cutting-edge machine-learning models to scientific applications.
 * Deliver high-quality and well-tested user-focused features.
 * Provide support to users of the platform.
 * Perform maintenance work and drive internal tech investments for platform stability, reliability and scalability.
 * Build observability and alerting mechanisms for the platform.
 * Improve the Continuous Integration/Continuous Deployment (CICD) setup of the platform.
 * Operate effectively in a fast-paced and ambiguous environment, ensuring independent delivery.
 * Provide great documentation and guidance for other contributors and users.


## Related Videos

- [Introduction to Azure Machine Learning](https://www.wearedevelopers.com/videos/368-introduction-to-azure-machine-learning)
- [Azure-Well Architected Framework - designing mission critical workloads in practice](https://www.wearedevelopers.com/videos/1529-azure-well-architected-framework-designing-mission-critical-workloads-in-practice)
- [Understanding Kubernetes in a visual way](https://www.wearedevelopers.com/videos/100085-understanding-kubernetes-in-a-visual-way)
- [Adjusting Pod Eviction Timings in Kubernetes](https://www.wearedevelopers.com/videos/426-adjusting-pod-eviction-timings-in-kubernetes)
- [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops)
- [What non-automotive Machine Learning projects can learn from automotive Machine Learning projects](https://www.wearedevelopers.com/videos/397-what-non-automotive-machine-learning-projects-can-learn-from-automotive-machine-learning-projects)

## Related Articles

- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)