Testing AI Agents: Automated Evaluation for Chatbots & RAG Systems
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Traditional string-matching tests are obsolete for non-deterministic AI agents. Discover how to build an AI testing pyramid using LLM-as-a-judge to catch silent chatbot regressions in your deployment pipelines.
Starting at 12:29 · Watch from the beginning
Checking access…
Playback and chapters load privately for Free videos.
Matching moments
More from World Congress 2026 Europe
Upcoming sessions on this topic
Starts in 8 days
Conference India 2026
November 25–26, 2026
Bengaluru, India
-
Did the Model Improve, or Just the Score? A Developer’s Guide to LLM Evaluation
Jack Fitzsimons · Blatent
Thu 26 Nov · Stage 1 - powered by IBM
-
The Illusion of Green: Why AI-Generated Browser Automation Tests Pass Locally but Fail in CI
Puja Jagani · BrowserStack
Wed 25 Nov · Stage 2
-
Teaching AI Coding Agents to Build It Right the First Time
Sajeetharan Sinnathurai · Microsoft
Thu 26 Nov · Stage 1 - powered by IBM
Related videos
Related articles
From learning to earning
Jobs that call for the skills explored in this talk.
about 2 months ago
•
AI Software Engineer (Germany)
Sunhat
Berlin, Germany
Expert
€70k–100k
Remote
REST
TypeScript
AI Frameworks
21 days ago
Applied AI Health Data System Engineer-Senior Manager
PwC
Kansas City, MO, United States
Expert
$124k–280k
Git
Keras
NoSQL
2 months ago
•
Principal Product Manager, Agentic Evals
Expedia
San Jose, United States
Expert
Hybrid · 3 days on-site
Product Management
2 months ago
•
Principal AI Forward Deployed Engineer
Expedia
San Jose, United States
Expert
Hybrid · 3 days on-site
AI Frameworks
Software Architecture
2 months ago
•
AI & Machine Learning Engineer (all genders)
msg
Frankfurt am Main, Germany
Experienced
Hybrid · 3 days on-site
Python
Langchain
Machine Learning
15 days ago
Senior Web Software Architect, AI Experiences
TeamViewer Germany GmbH
Austin, TX, United States
Expert
ReactJS
TypeScript
TeamViewer