> Markdown version of [/jobs/ext/2806461-ai-qa-evaluation-engineer-scale-metrics-for-ml](https://www.wearedevelopers.com/jobs/ext/2806461-ai-qa-evaluation-engineer-scale-metrics-for-ml). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# AI QA Evaluation Engineer: Scale Metrics for ML

- **Company:** Appnovation Technologies
- **Location:** Greater London, UK
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Continuous Integration, Python (Programming Language), Large Language Models
- **Published:** September 9, 2026
- **Apply:** https://www.collegerecruiter.com/job/2856364113-ai-qa-evaluation-engineer-scale-metrics-for-ml

## About the Role

Applicants should have a strong background in QA/test engineering, Python, and experience with LLM evaluation frameworks, plus the ability to design automated evaluation harnesses and integrate them with CI/CD.
#J-18808-Ljbffr

## Description

Appnovation Technologies is seeking a QA / AI Evaluation Engineer to join a forward-thinking data/ML focused team. You will run large-scale evals, measure factual grounding and accuracy lift, and build metrics frameworks to demonstrate quality improvements across AI outputs.


## Related Videos

- [Creating Industry ready solutions with LLM Models](https://www.wearedevelopers.com/videos/899-creating-industry-ready-solutions-with-llm-models)
- [100 times more frequent deployments: How did we create a high performance team?](https://www.wearedevelopers.com/videos/1069-100-times-more-frequent-deployments-how-did-we-create-a-high-performance-team)
- [Edit Your Future: Queerverse Radical AI](https://www.wearedevelopers.com/videos/909-edit-your-future-queerverse-radical-ai)
- [AI as a Test Designer: Transforming Experience into Automated Testing](https://www.wearedevelopers.com/videos/1984-ai-as-a-test-designer-transforming-experience-into-automated-testing)
- [Bringing the power of AI to your application.](https://www.wearedevelopers.com/videos/1010-bringing-the-power-of-ai-to-your-application)
- [Lies, Damned Lies and Large Language Models](https://www.wearedevelopers.com/videos/1231-lies-damned-lies-and-large-language-models)

## Related Articles

- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Trustworthy AI Starts at Deployment: 5 Checks Before You Ship](https://www.wearedevelopers.com/magazine/753-trustworthy-ai-starts-at-deployment-5-checks-before-you-ship)
- [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)
- [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)