WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2026 Europe • Jul 10, 2026 • Session details

Testing AI Agents: Automated Evaluation for Chatbots & RAG Systems

Sebastian Messingfeld

Traditional string-matching tests are obsolete for non-deterministic AI agents. Discover how to build an AI testing pyramid using LLM-as-a-judge to catch silent chatbot regressions in your deployment pipelines.

Starting at 1:53 · Watch from the beginning

Testing AI Agents: Automated Evaluation for Chatbots & RAG Systems thumbnail

Checking access…

Playback and chapters load privately for Free videos.

Matching moments

4:06 min

Debating the reliability of AI agents for quality assurance

Haimantika Mitra Haimantika Mitra +2 · LIVE

2:11 min

Applying the testing pyramid to AI failures

Eric Deandrea Eric Deandrea · World Congress 2026 North America

1:56 min

Introduction to evaluating AI code review agents

Sofia Rest Sofia Rest · World Congress 2026 North America

2:37 min

Evaluating engineering candidates through AI-assisted coding interviews

Philipp Richter +2 · Coffee With Developers

2:28 min

Introduction to building reliable AI agents in production

Max Tkacz Max Tkacz · World Congress 2025

4:07 min

Running automated evaluation tests for conversational tool selection

Rishabh Budhiraja Rishabh Budhiraja +1 · World Congress 2026 Europe

More from World Congress 2026 Europe

Building the Nervous System of AI - Michael Kagan (NVIDIA) thumbnail
29:17

Building the Nervous System of AI - Michael Kagan (NVIDIA)

Michael Kagan +1

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote thumbnail
19:41

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote

Christian Heilmann · WeAreDevelopers

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend thumbnail
32:06

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend

David vonThenen · NetApp

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes thumbnail
35:13

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes

Irina Branovic · adjoe

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬 thumbnail
24:23

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬

Jeremy Murray · Stack8s

Angstfreude - AI and Corporate Culture - The Thrill and the Threat thumbnail
30:26

Angstfreude - AI and Corporate Culture - The Thrill and the Threat

Axel Ebert +1

Upcoming sessions on this topic

Starts in 12 days

Conference India 2026

November 25–26, 2026

Bengaluru, India

Get tickets All 107 sessions

Related videos

Who Tests the AI? Building Trustworthy AI Systems at Enterprise Scale thumbnail
27:57

Who Tests the AI? Building Trustworthy AI Systems at Enterprise Scale

Him Raj Singh · PayPal

World Congress North America · 2026

Reinventing Testing Practices in the AI Era thumbnail
30:19

Reinventing Testing Practices in the AI Era

Eric Deandrea · IBM

World Congress North America · 2026

AI as a Test Designer: Transforming Experience into Automated Testing thumbnail
30:46

AI as a Test Designer: Transforming Experience into Automated Testing

Alisa Hrustic · System Verification

Europe Virtual · 2026

Beyond Chatbots: How to build Agentic AI systems thumbnail
24:22

Beyond Chatbots: How to build Agentic AI systems

Philipp Schmid · Google DeepMind

World Congress · 2025

Test Before Release, Enforce at Runtime: Governance for Tool-Using AI Agents thumbnail
21:16

Test Before Release, Enforce at Runtime: Governance for Tool-Using AI Agents

Sachin Gupta · eBay

World Congress North America · 2026

AI Agents & Agentic AI thumbnail
26:53

AI Agents & Agentic AI

Xavier Sala Presas · SCHWARZ Digits

Europe Virtual · 2026

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.