> Markdown version of [/jobs/ext/2972733-ai-automation-tester](https://www.wearedevelopers.com/jobs/ext/2972733-ai-automation-tester). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# AI Automation Tester

- **Company:** Sanderson Recruitment Plc
- **Location:** London, UK
- **Salary:** £96,200.0 - £145,600.0
- **Contract:** Permanent contract
- **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Automation of Tests, Continuous Integration, Regression Testing, Test Data, Scripting, Performance Testing, Large Language Models, Generative AI, Integration Tests, Data Management, Api Management
- **Published:** September 18, 2026
- **Apply:** https://www.reed.co.uk/jobs/ai-automation-tester/57359463

## About the Role

We're looking for candidates with strong experience across:

 * Test Automation
 * API Testing
 * Functional Testing
 * Integration Testing
 * Regression Testing
 * Performance Testing
 * Automated test frameworks and scripting
 * Test data management
 * Continuous testing / CI/CD environments
 * Defect identification, investigation and management

Experience testing AI, Generative AI or LLM-based solutions would be particularly valuable, including experience evaluating the quality, consistency and accuracy of AI responses.

AI Testing

Alongside traditional automation testing, an important part of the role will be understanding how to effectively test an AI-enabled solution.

Relevant experience could include:

 * AI response evaluation and validation
 * Testing non-deterministic AI outputs
 * Developing test scenarios and evaluation criteria for AI responses
 * Testing AI APIs and integrations
 * Automated evaluation of AI functionality
 * Identifying unexpected, inconsistent or inappropriate model responses
 * Building AI-specific testing into wider automated test suites

Candidates don't necessarily need to come exclusively from an "AI Tester" background, but should have strong automation testing fundamentals and ideally some practical exposure to testing AI/LLM-enabled applications.

## Description

We are looking for an AI Automation Tester to support IBM on a major programme of work

The role will focus on designing and executing automated testing across an AI-enabled solution, covering traditional functional and integration testing alongside the additional challenges involved in validating AI-generated responses and behaviours.

You'll work as part of the wider delivery team to ensure the solution is reliable, performs as expected and continues to meet requirements as it develops., * Design, build and maintain automated tests across the AI solution

 * Execute functional, integration and regression testing
 * Develop and maintain automated test suites
 * Perform API testing across integrated services
 * Validate AI-generated responses and system behaviours
 * Design appropriate test scenarios for AI functionality
 * Manage and maintain test data required across different testing activities
 * Test integrations between the AI solution and wider systems/services
 * Support performance testing and identify potential issues or bottlenecks
 * Analyse test results, identify defects and work with technical teams through resolution
 * Support continuous testing throughout the delivery lifecycle
 * Ensure appropriate regression coverage as the solution evolves
 * Work closely with developers, engineers and wider delivery stakeholders


## Related Videos

- [AI as a Test Designer: Transforming Experience into Automated Testing](https://www.wearedevelopers.com/videos/1984-ai-as-a-test-designer-transforming-experience-into-automated-testing)
- [Dirty Tests And How To Clean Them](https://www.wearedevelopers.com/videos/515-dirty-tests-and-how-to-clean-them)
- [JavaScript? No. Java Scripts! - Scripting with Java](https://www.wearedevelopers.com/videos/2094-javascript-no-java-scripts-scripting-with-java)
- [Your imaginations is (no longer) the limit: how Generative AI empowers people to be creative](https://www.wearedevelopers.com/videos/741-your-imaginations-is-no-longer-the-limit-how-generative-ai-empowers-people-to-be-creative)
- [Back to the Roots: Testing in the Age of AI](https://www.wearedevelopers.com/videos/100021-back-to-the-roots-testing-in-the-age-of-ai)
- [Stop Guessing, Start Measuring: Evaluating RAG Systems with Synthetic Test Data](https://www.wearedevelopers.com/videos/1982-stop-guessing-start-measuring-evaluating-rag-systems-with-synthetic-test-data)

## Related Articles

- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [Transforming Software Development: The Role of AI and Developer Tools](https://www.wearedevelopers.com/magazine/527-transforming-software-development-the-role-of-ai-and-developer-tools)
- [The 8 Best Code Testing Tools](https://www.wearedevelopers.com/magazine/402-the-8-best-code-testing-tools)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [What Industries Outside of AI Are Hiring The Most AI Experts?](https://www.wearedevelopers.com/magazine/98-what-industries-outside-of-ai-are-hiring-the-most-ai-experts)