WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2026 Europe • Jul 10, 2026 • Session details

Testing AI Agents: Automated Evaluation for Chatbots & RAG Systems

Sebastian Messingfeld

Traditional string-matching tests are obsolete for non-deterministic AI agents. Discover how to build an AI testing pyramid using LLM-as-a-judge to catch silent chatbot regressions in your deployment pipelines.

Testing AI Agents: Automated Evaluation for Chatbots & RAG Systems thumbnail

Checking access…

Playback and chapters load privately for Free videos.

Matching moments

2:11 min

Applying the testing pyramid to AI failures

Eric Deandrea Eric Deandrea · World Congress 2026 North America

1:56 min

Introduction to evaluating AI code review agents

Sofia Rest Sofia Rest · World Congress 2026 North America

2:37 min

Evaluating engineering candidates through AI-assisted coding interviews

Philipp Richter Philipp Richter +2 · Coffee With Developers

2:28 min

Introduction to building reliable AI agents in production

Max Tkacz Max Tkacz · World Congress 2025

4:07 min

Running automated evaluation tests for conversational tool selection

Rishabh Budhiraja Rishabh Budhiraja +1 · World Congress 2026 Europe

2:06 min

Rethinking team structures around AI agent capabilities

Mike Mike · World Congress 2025

More from World Congress 2026 Europe

Building the Nervous System of AI - Michael Kagan (NVIDIA) thumbnail
29:17

Building the Nervous System of AI - Michael Kagan (NVIDIA)

Michael Kagan +1

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote thumbnail
19:41

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote

Christian Heilmann · WeAreDevelopers

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend thumbnail
32:06

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend

David vonThenen · NetApp

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes thumbnail
35:13

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes

Irina Branovic · adjoe

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬 thumbnail
24:23

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬

Jeremy Murray · Stack8s

Angstfreude - AI and Corporate Culture - The Thrill and the Threat thumbnail
30:26

Angstfreude - AI and Corporate Culture - The Thrill and the Threat

Axel Ebert +1

Upcoming sessions on this topic

Open session

Did the Model Improve, or Just the Score? A Developer’s Guide to LLM Evaluation

  • Jack Fitzsimons

    Blatent

    CTO and Co-Founder

Open session

The Illusion of Green: Why AI-Generated Browser Automation Tests Pass Locally but Fail in CI

  • Puja Jagani

    BrowserStack

    Lead of Open Source and Developer Advocacy

Open session

Teaching AI Coding Agents to Build It Right the First Time

  • Sajeetharan Sinnathurai

    Microsoft

    Principal Product Manager

Open session

Your AI Wrote the Code. Who Vouches for It?

  • Siddharth Joshi

    GitHub

    Senior Customer Success Architect

Open session

Ship Happens: Guardrails for AI-Written Code

  • Anthony Nguyen

    LaunchDarkly

    Senior Solutions Engineer

Open session

From RAG to Real Impact: Building Smarter AI Assistants

  • Poornima Nayak

    IBM

    Program Director

Related videos

Who Tests the AI? Building Trustworthy AI Systems at Enterprise Scale thumbnail
27:57

Who Tests the AI? Building Trustworthy AI Systems at Enterprise Scale

Him Raj Singh · PayPal

World Congress North America · 2026

Reinventing Testing Practices in the AI Era thumbnail
30:19

Reinventing Testing Practices in the AI Era

Eric Deandrea · IBM

World Congress North America · 2026

AI as a Test Designer: Transforming Experience into Automated Testing thumbnail
30:46

AI as a Test Designer: Transforming Experience into Automated Testing

Alisa Hrustic · System Verification

Europe Virtual · 2026

Beyond Chatbots: How to build Agentic AI systems thumbnail
24:22

Beyond Chatbots: How to build Agentic AI systems

Philipp Schmid · Google DeepMind

World Congress · 2025

Test Before Release, Enforce at Runtime: Governance for Tool-Using AI Agents thumbnail
21:16

Test Before Release, Enforce at Runtime: Governance for Tool-Using AI Agents

Sachin Gupta · eBay

World Congress North America · 2026

AI Agents & Agentic AI thumbnail
26:53

AI Agents & Agentic AI

Xavier Sala Presas · SCHWARZ Digits

Europe Virtual · 2026

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.