AI Transformation Lead
Role details
Job location
Tech stack
Job description
Our client is delivering AI-powered digital capabilities within a secure public sector environment. They are building and scaling intelligent agents on the Salesforce AgentForce platform and need a dedicated Tester to ensure these agents are accurate, reliable, safe, and production-ready.
This is not traditional UI testing. You will be validating AI behaviour, conversational accuracy, workflow logic, integrations, and compliance standards. You will sit between Product, Engineering, and business stakeholders to ensure agents perform as intended across real-world use cases.
What You'll Be Doing
- Designing and executing structured test plans for AI agents within the AgentForce environment.
- Testing conversational flows, APIs, integrations, CRM interfaces, and multi-channel deployments.
- Validating intent recognition, response quality, business rule adherence, and safety guardrails.
- Conducting regression testing after retraining, fine-tuning, or configuration updates.
- Logging reproducible defects and working closely with engineers to validate fixes.
- Analysing conversation logs to identify misclassifications, edge cases, and optimisation opportunities.
- Monitoring metrics such as accuracy, latency, escalation rates, and user satisfaction.
- Supporting compliance, audit readiness, and responsible AI standards in a regulated setting., Overview Area Director of Partnerships (Remote Estate Agency Model) Role Title: Area Director of Partnerships Covering: West Midlands Role Purpose: The Area Director is responsible for leading, scaling, and optimising estate agency performance across a defined team..., We are looking for a talented and ambitious Technical Director - Clerk of Works whois dedicated to providingan excellent service to join and develop our growing and successful Clerk of Works team. As a Technical Director at Gateley RJA, you will play a pivotal role in the...
Requirements
- Proven experience in software testing, QA, or conversational AI testing.
- Exposure to functional, regression, exploratory, and UAT methodologies.
- Understanding of AI or LLM-based systems, chatbot testing, or NLP concepts.
- Working knowledge of JSON, APIs, and automation frameworks.
- Strong analytical capability with attention to detail.
- Experience in agile delivery environments.
Highly desirable:
- Experience with Salesforce AgentForce, Agent Builder, or AgentForce Testing Centre.
- Exposure to Einstein or similar AI agent platforms.
- Experience in secure or regulated environments.
Keywords that will stand out: AgentForce, Agent Builder, Testing Centre, AI Agent QA., This role suits a technically strong QA professional who understands AI systems beyond surface-level testing. You are structured, detail-driven, comfortable working with ambiguity, and capable of challenging agent outputs where logic or safety is compromised.
You must be SC clearable and a sole British national. Non-cleared profiles may be considered if technically strong.
If your background includes AgentForce Builder or Testing Centre experience, flag this clearly when applying., Launch your career in property with haart Estate Agents in Harborne. We're offering a fantastic entry-level opportunity to join our successful team as a Trainee Lettings Negotiator. No previous experience is required just enthusiasm, drive, and a positive attitude. With...
Benefits & conditions
- £575-£595 per day.
- Remote-first model with minimal London travel.
- 6-month initial contract with strong likelihood of extension.
- Exposure to AI transformation work within a high-impact government department.