> Markdown version of [/jobs/ext/2304307-artificial-intelligence-test-engineer](https://www.wearedevelopers.com/jobs/ext/2304307-artificial-intelligence-test-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Artificial Intelligence Test Engineer

- **Company:** Avensys Ltd
- **Location:** Cambridge, UK
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Testing (Software), .NET Framework, Application Programming Interfaces (APIs), Artificial Intelligence, Microsoft Azure, Profiling, Open Web Application Security, Scrum Methodology, Rapid Prototyping Process, Software Safety, Strategies of Testing, Spring Cloud, Large Language Models, Prompt Engineering, AI Platforms, Api Management, Serverless Computing
- **Published:** August 30, 2026
- **Apply:** https://www.collegerecruiter.com/job/2815454384-artificial-intelligence-test-engineer

## About the Role

* Familiarity with LLM evaluation techniques, output scoring, and validation frameworks.
 * Understanding of prompt engineering, RAG, model orchestration, and hallucination detection.
 * Experience in testing for accuracy, relevance, and consistency of AI model predictions/generations.
 * Defining performance metrics for AI services and testing for the same.
 * Awareness of AI safety, bias detection, and explainability techniques.
 * Experience ensuring compliance with AI regulations and standards (e.g., NIST AI RMF, EU AI Act).
 * Strong belief in ethical AI practices, transparency, and end-user trust.
 * 12+ years of experience in software testing, QA, or validation roles for cloud-native applications using Microsoft and .NET technologies.
 * Proficient in designing automated testing frameworks.
 * Hands-on experience with Azure DevOps, CI/CD pipelines, and containerized architectures.
 * Strong understanding of API testing, performance profiling, and security testing (including OWASP Top 10).
 * Excellent problem-solving skills with the ability to analyze complex technical challenges and propose scalable solutions.
 * Experience working in Agile teams and collaborating across global R&D locations.
 * Demonstrated ability to mentor junior team members and foster a culture of continuous learning and innovation.

## Description

* We are looking for a detail-oriented and forward-thinking Test Engineer to ensure the quality, performance, and security of our Core AI Services. You will help validate distributed, cloud-native services and public APIs that form the foundation for enterprise AI capabilities.
 * You'll be part of a Scrum team and work closely with developers and architects to design effective validation strategies, automated testing frameworks, and AI-specific evaluation tools, with a builder mindset, rapid prototyping and continuous improvement, and agility of a start-up.


## Related Videos

- [AI as a Test Designer: Transforming Experience into Automated Testing](https://www.wearedevelopers.com/videos/1984-ai-as-a-test-designer-transforming-experience-into-automated-testing)
- [Profiling Symfony & PHP apps with Blackfire](https://www.wearedevelopers.com/videos/265-profiling-symfony-php-apps-with-blackfire)
- [This App Reached 10,000 Users in One Week. Here's How.](https://www.wearedevelopers.com/videos/100329-this-app-reached-10-000-users-in-one-week-here-s-how)
- [Serverless Architectures with Spring Cloud Functions and Knative](https://www.wearedevelopers.com/videos/814-serverless-architectures-with-spring-cloud-functions-and-knative)
- [Introduction to Responsible AI: Balancing Value and Risk](https://www.wearedevelopers.com/videos/1972-introduction-to-responsible-ai-balancing-value-and-risk)
- [Enhancing Workload Security in Kubernetes](https://www.wearedevelopers.com/videos/356-enhancing-workload-security-in-kubernetes)

## Related Articles

- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [Trustworthy AI Starts at Deployment: 5 Checks Before You Ship](https://www.wearedevelopers.com/magazine/753-trustworthy-ai-starts-at-deployment-5-checks-before-you-ship)
- [The State of WebDev AI 2025 Results: What Can We Learn?](https://www.wearedevelopers.com/magazine/581-the-state-of-webdev-ai-2025-results-what-can-we-learn)
- [Transforming Software Development: The Role of AI and Developer Tools](https://www.wearedevelopers.com/magazine/527-transforming-software-development-the-role-of-ai-and-developer-tools)