AI Test Lead
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
Job description
Experteer Overview In this role you will establish and drive testing and quality assurance for AI-enabled systems, ensuring trustworthy and compliant deployment in a regulated financial services context. You will work with cross-functional teams to shape AI testing frameworks that handle probabilistic behavior and guardrails, while integrating automation into DevOps/MLOps. The position offers hybrid working with offices in Bradford and Leeds and values a people-centered, flexible culture. You will be instrumental in balancing innovation with risk and regulatory expectations to deliver reliable AI solutions. Pay / Benefits * Develop AI testing frameworks that account for nondeterminism, probabilistic outputs, and variability in AI responses * Embed responsible AI and risk testing by defining test cases for bias, fairness, transparency, safety and guardrails * Implement automated AI testing capabilities and integrate testing into DevOps and MLOps pipelines * Collaborate with delivery and governance teams to ensure testing aligns with engineering standards, regulatory expectations, and assurance requirements Tasks * Strong experience in testing and quality assurance for complex systems * Working knowledge of AI and machine learning technologies, including LLMs and RAG * Familiarity with test automation, DevOps pipelines, and MLOps practices * Experience with Microsoft Azure, Azure AI services, and Copilot-based solutions * Strong collaboration and communication skills with nontechnical stakeholders Key requirements * 25 days holiday plus Bank Holidays, with option to buy up to 5 additional days * flexible working options * on target bonus 7% of eligible pay (up to 15% maximum) * pension contributions up to 11% * private medical insurance and dental/healthcare plans * My Benefits portal with discounts
Requirements
_ governance teams to ensure testing aligns with engineering standards, regulatory expectations, and assurance requirements Tasks * Strong experience in testing and quality assurance for complex systems * Working knowledge of AI and machine learning technologies, including LLMs and RAG * Familiarity with test automation, DevOps pipelines, and MLOps practices * Experience with Microsoft Azure, Azure AI services, and Copilot-based solutions * Strong collaboration and communication skills with nontechnical stakeholders Key requirements * 25 days holiday plus Bank Holidays, with option to buy up to 5 additional days * flexible working options * on target bonus 7% of eligible pay (up to 15% maximum) * pension contributions up to 11% * private medical insurance and dental/healthcare plans * My Benefits portal with discounts
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on eu.experteer.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
How to Become an AI Engineer
MLOps And AI Driven Development
Data Analyst Salary in the UK
Dev Digest 137 - AI'm not sure about this