> Markdown version of [/jobs/ext/96813-ai-test-lead](https://www.wearedevelopers.com/jobs/ext/96813-ai-test-lead). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# AI Test Lead

- **Company:** Yorkshire Building Society
- **Location:** Leeds, UK (Remote available)
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Automation of Tests, Microsoft Azure, DevOps, Azure Machine Learning, Delivery Pipeline, Large Language Models, Machine Learning Operations
- **Published:** May 15, 2026
- **Apply:** https://uk.indeed.com/viewjob?jk=a0d30faf4e672830

## About the Role

Do you have experience in Test automation?, You will have

 * Strong experience in testing and quality assurance for complex systems
 * Working knowledge of AI and machine learning technologies, including large language models and RetrievalAugmented Generation (RAG)
 * Familiarity with test automation, DevOps pipelines, and MLOps practices
 * Experience working with Microsoft Azure, Azure AI services, and Copilotbased solutions
 * Strong collaboration and communication skills, including engagement with nontechnical stakeholders

## Description

Are you passionate about making a difference, using your skills & experience to be a key enabler of AI-driven transformation? If so, we may have the role for you!

We are excited to share an incredible opportunity for an AI Test Lead to join our team in Data & AI. As our newest AI Test Lead, you will be responsible for defining and leading testing and quality assurance practices for AI-enabled systems and solutions.

This is a hybrid role with working from home plus some onsite presence in our Bradford & central Leeds offices.

About the role

The role addresses the unique challenges of testing AI systems, including probabilistic behaviour, variability in outputs, and responsible AI considerations. Through robust testing frameworks and collaboration with delivery and governance teams, the role supports compliant and trustworthy deployment of AI solutions within a regulated financial services environment.

You will-

 * Develop AI testing frameworks and methodologies that account for nondeterministic behaviour, probabilistic outputs, and variability in AI responses.
 * Embed responsible AI and risk testing by defining test cases that assess bias, fairness, transparency, safety, and the effectiveness of AI guardrails.
 * Implement automated AI testing capabilities by developing test automation and integrating testing activities into DevOps and MLOps pipelines.
 * Collaborate across delivery and governance teams to ensure testing practices align with engineering standards, regulatory expectations, and enterprise assurance requirements.


## Related Videos

- [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform)
- [How will artificial intelligence change the future of software testing?](https://www.wearedevelopers.com/videos/85-how-will-artificial-intelligence-change-the-future-of-software-testing)
- [Developer Tools for Microsoft Azure](https://www.wearedevelopers.com/videos/450-developer-tools-for-microsoft-azure)
- [AI as a Test Designer: Transforming Experience into Automated Testing](https://www.wearedevelopers.com/videos/1984-ai-as-a-test-designer-transforming-experience-into-automated-testing)
- [Agentic AI - From Theory to Practice: Developing Multi-Agent AI Systems on Azure](https://www.wearedevelopers.com/videos/1532-agentic-ai-from-theory-to-practice-developing-multi-agent-ai-systems-on-azure)
- [DevOps Maturity Check – a way to balance autonomy and alignment](https://www.wearedevelopers.com/videos/58-devops-maturity-check-a-way-to-balance-autonomy-and-alignment)

## Related Articles

- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)
- [What Industries Outside of AI Are Hiring The Most AI Experts?](https://www.wearedevelopers.com/magazine/98-what-industries-outside-of-ai-are-hiring-the-most-ai-experts)
- [Top AI Tools for Developers in 2025](https://www.wearedevelopers.com/magazine/560-top-ai-tools-for-developers-in-2025)