> Markdown version of [/jobs/ext/1998085-ai-test-lead](https://www.wearedevelopers.com/jobs/ext/1998085-ai-test-lead). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# AI Test Lead

- **Company:** Yorkshire Building Society
- **Location:** Leeds, UK
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Automation of Tests, Microsoft Azure, DevOps, Azure Machine Learning, Delivery Pipeline, Large Language Models, Machine Learning Operations
- **Published:** August 9, 2026
- **Apply:** https://eu.experteer.com/career/view-jobs/ai-test-lead-leeds-grossbritannien-58862852

## About the Role

_ governance teams to ensure testing aligns with engineering standards, regulatory expectations, and assurance requirements Tasks * Strong experience in testing and quality assurance for complex systems * Working knowledge of AI and machine learning technologies, including LLMs and RAG * Familiarity with test automation, DevOps pipelines, and MLOps practices * Experience with Microsoft Azure, Azure AI services, and Copilot-based solutions * Strong collaboration and communication skills with nontechnical stakeholders Key requirements * 25 days holiday plus Bank Holidays, with option to buy up to 5 additional days * flexible working options * on target bonus 7% of eligible pay (up to 15% maximum) * pension contributions up to 11% * private medical insurance and dental/healthcare plans * My Benefits portal with discounts

## Description

Experteer Overview In this role you will establish and drive testing and quality assurance for AI-enabled systems, ensuring trustworthy and compliant deployment in a regulated financial services context. You will work with cross-functional teams to shape AI testing frameworks that handle probabilistic behavior and guardrails, while integrating automation into DevOps/MLOps. The position offers hybrid working with offices in Bradford and Leeds and values a people-centered, flexible culture. You will be instrumental in balancing innovation with risk and regulatory expectations to deliver reliable AI solutions. Pay / Benefits * Develop AI testing frameworks that account for nondeterminism, probabilistic outputs, and variability in AI responses * Embed responsible AI and risk testing by defining test cases for bias, fairness, transparency, safety and guardrails * Implement automated AI testing capabilities and integrate testing into DevOps and MLOps pipelines * Collaborate with delivery and governance teams to ensure testing aligns with engineering standards, regulatory expectations, and assurance requirements Tasks * Strong experience in testing and quality assurance for complex systems * Working knowledge of AI and machine learning technologies, including LLMs and RAG * Familiarity with test automation, DevOps pipelines, and MLOps practices * Experience with Microsoft Azure, Azure AI services, and Copilot-based solutions * Strong collaboration and communication skills with nontechnical stakeholders Key requirements * 25 days holiday plus Bank Holidays, with option to buy up to 5 additional days * flexible working options * on target bonus 7% of eligible pay (up to 15% maximum) * pension contributions up to 11% * private medical insurance and dental/healthcare plans * My Benefits portal with discounts


## Related Videos

- [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform)
- [How will artificial intelligence change the future of software testing?](https://www.wearedevelopers.com/videos/85-how-will-artificial-intelligence-change-the-future-of-software-testing)
- [AI as a Test Designer: Transforming Experience into Automated Testing](https://www.wearedevelopers.com/videos/1984-ai-as-a-test-designer-transforming-experience-into-automated-testing)
- [Developer Tools for Microsoft Azure](https://www.wearedevelopers.com/videos/450-developer-tools-for-microsoft-azure)
- [Agentic AI - From Theory to Practice: Developing Multi-Agent AI Systems on Azure](https://www.wearedevelopers.com/videos/1532-agentic-ai-from-theory-to-practice-developing-multi-agent-ai-systems-on-azure)
- [Agentic employees in world's most downloaded FinTech app](https://www.wearedevelopers.com/videos/100123-agentic-employees-in-world-s-most-downloaded-fintech-app)

## Related Articles

- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [Dev Digest 137 - AI'm not sure about this](https://www.wearedevelopers.com/magazine/485-dev-digest-137-ai-m-not-sure-about-this)
- [13 AI Tools You Have to Try](https://www.wearedevelopers.com/magazine/219-13-ai-tools-you-have-to-try)