AI Transformation Lead

Spicerhaart
Cardiff, United Kingdom
14 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
£ 155K

Job location

Remote
Cardiff, United Kingdom

Tech stack

API
Artificial Intelligence
JSON
Regression Testing
Salesforce
Systems Integration
User Interface Testing
Data Logging
Chatbots
Large Language Models

Job description

Our client is delivering AI-powered digital capabilities within a secure public sector environment. They are building and scaling intelligent agents on the Salesforce AgentForce platform and need a dedicated Tester to ensure these agents are accurate, reliable, safe, and production-ready.

This is not traditional UI testing. You will be validating AI behaviour, conversational accuracy, workflow logic, integrations, and compliance standards. You will sit between Product, Engineering, and business stakeholders to ensure agents perform as intended across real-world use cases.

What You'll Be Doing

  • Designing and executing structured test plans for AI agents within the AgentForce environment.
  • Testing conversational flows, APIs, integrations, CRM interfaces, and multi-channel deployments.
  • Validating intent recognition, response quality, business rule adherence, and safety guardrails.
  • Conducting regression testing after retraining, fine-tuning, or configuration updates.
  • Logging reproducible defects and working closely with engineers to validate fixes.
  • Analysing conversation logs to identify misclassifications, edge cases, and optimisation opportunities.
  • Monitoring metrics such as accuracy, latency, escalation rates, and user satisfaction.
  • Supporting compliance, audit readiness, and responsible AI standards in a regulated setting., Overview Area Director of Partnerships (Remote Estate Agency Model) Role Title: Area Director of Partnerships Covering: West Midlands Role Purpose: The Area Director is responsible for leading, scaling, and optimising estate agency performance across a defined team..., We are looking for a talented and ambitious Technical Director - Clerk of Works whois dedicated to providingan excellent service to join and develop our growing and successful Clerk of Works team. As a Technical Director at Gateley RJA, you will play a pivotal role in the...

Requirements

  • Proven experience in software testing, QA, or conversational AI testing.
  • Exposure to functional, regression, exploratory, and UAT methodologies.
  • Understanding of AI or LLM-based systems, chatbot testing, or NLP concepts.
  • Working knowledge of JSON, APIs, and automation frameworks.
  • Strong analytical capability with attention to detail.
  • Experience in agile delivery environments.

Highly desirable:

  • Experience with Salesforce AgentForce, Agent Builder, or AgentForce Testing Centre.
  • Exposure to Einstein or similar AI agent platforms.
  • Experience in secure or regulated environments.

Keywords that will stand out: AgentForce, Agent Builder, Testing Centre, AI Agent QA., This role suits a technically strong QA professional who understands AI systems beyond surface-level testing. You are structured, detail-driven, comfortable working with ambiguity, and capable of challenging agent outputs where logic or safety is compromised.

You must be SC clearable and a sole British national. Non-cleared profiles may be considered if technically strong.

If your background includes AgentForce Builder or Testing Centre experience, flag this clearly when applying., Launch your career in property with haart Estate Agents in Harborne. We're offering a fantastic entry-level opportunity to join our successful team as a Trainee Lettings Negotiator. No previous experience is required just enthusiasm, drive, and a positive attitude. With...

Benefits & conditions

  • £575-£595 per day.
  • Remote-first model with minimal London travel.
  • 6-month initial contract with strong likelihood of extension.
  • Exposure to AI transformation work within a high-impact government department.

About the company

Job Description Location: Birmingham/ Manchester/ Glasgow/ Edinburgh/ Perth/ Cardiff Amey are a leading provider of full life-cycle engineering, operations and decarbonisation solutions, for transport infrastructure and complex facilities. Working for us, you'll be..., Amey are a leading provider of full life-cycle engineering, operations and decarbonisation solutions, for transport infrastructure and complex facilities. Working for us, you'll be delivering sustainable infrastructure solutions that enhance life and protect our shared..., About the BusinessQuilter Cheviot has been the wealth manager of choice for individuals and families for over 250 years, and today is one of the UK's largest wealth management firms offering expert discretionary investment management and financial advice. We offer a highly..., Osaic Careers Be a part of the team behind our success! All financial services distribution companies are not created equal. Highland Capital Brokerage, a member company of Osaic, offers an unparalleled national team dedicated to supporting financial advisors who want to..., The Setup: A high-growth agile unit within the global STARLIMS ecosystem. STARLIMS provides leading Laboratory Information Management System (LIMS) solutions that have served customers around the world for over 30 years. Our solution suite helps labs: - Improve the..., Geotechnical EngineerAmey are a leading provider of full life-cycle engineering, operations and decarbonisation solutions, for transport infrastructure and complex facilities. TitleGeotechnical Engineer Requisition ID10219 OpportunityWe have a fantastic opportunity for a..., Join the U.K's largest independent property services group as an Assistant Branch Manager, where no two days are the same, and where you can deliver exceptional service to both landlords and tenants. This is your opportunity to grow your career with a respected name in the...

Apply for this position