> Markdown version of [/jobs/ext/2159754-ai-evaluation-engineer](https://www.wearedevelopers.com/jobs/ext/2159754-ai-evaluation-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# AI Evaluation Engineer

- **Company:** SUMMER-BROWNING ASSOCIATES LIMITED
- **Location:** Horncastle, UK
- **Contract:** Temporary contract
- **Skills:** Artificial Intelligence, Automation of Tests, Cloud Engineering, Python (Programming Language), Software Safety, Software Organization, Large Language Models, Data Analytics, Machine Learning Operations
- **Published:** August 21, 2026
- **Apply:** https://www.cv-library.co.uk/job/225519861/ai-evaluation-engineer

## About the Role

The team is looking for an experienced, hands-on developer who can create their own base code, set it up and work it out. Experience applying and working with AI model layer & agentic layer, * proven experience in quality engineering, testing or evaluation of data-driven and AI-powered products.

 * strong understanding of machine learning systems, large language models (LLMs) and AI evaluation methodologies for production.
 * experience defining performance metrics, KPIs, benchmarks and acceptance criteria for AI products.
 * ability to translate business risks and policy requirements into measurable technical evaluation frameworks.
 * experience developing automated testing and evaluation pipelines using Python or similar technologies.
 * knowledge of AI safety, model robustness, bias, fairness and responsible AI principles.
 * strong analytical and problem-solving skills with the ability to identify trends, risks and performance issues.
 * experience working with cross-functional teams in agile product delivery environments.
 * ability to communicate complex technical findings clearly to both technical and non-technical audiences.
 * experience producing technical reports, dashboards and recommendations for senior stakeholders.
 * familiarity with cloud-based AI platforms and modern software development practices.
 * experience working in government, public sector or regulated environments is desirable.

NB: The successful candidate may need to undergo SC while in post, so must be eligible/willing to attain. However the successful candidate can start on BPSS

## Description

SBA are currently supporting our Central Government client who are seeking an AI Evaluation Engineer on an initial 4 month contract.


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Psychological Safety in Software Engineering - Jenny-Margrethe Vej & Alexandra Hou Aldershaab](https://www.wearedevelopers.com/videos/2142-psychological-safety-in-software-engineering-jenny-margrethe-vej-alexandra-hou-aldershaab)
- [The Cloud is Calling: Answer with In-Demand Skills](https://www.wearedevelopers.com/videos/945-the-cloud-is-calling-answer-with-in-demand-skills)
- [Introduction to Responsible AI: Balancing Value and Risk](https://www.wearedevelopers.com/videos/1972-introduction-to-responsible-ai-balancing-value-and-risk)
- [How Data is Shaping our Games](https://www.wearedevelopers.com/videos/176-how-data-is-shaping-our-games)
- [AI for decision-making in Tech Recruiting](https://www.wearedevelopers.com/videos/1074-ai-for-decision-making-in-tech-recruiting)

## Related Articles

- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [Trustworthy AI Starts at Deployment: 5 Checks Before You Ship](https://www.wearedevelopers.com/magazine/753-trustworthy-ai-starts-at-deployment-5-checks-before-you-ship)
- [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)