WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2026 North America • Sep 26, 2026 • Session details

21 Experiments in Six Weeks: A Playbook for Improving Your AI Agent

Sofia Rest

Think upgrading to a smarter model automatically improves your AI agent? Sentry ran 21 A/B tests in six weeks and discovered that more expensive models can actually hurt performance.

21 Experiments in Six Weeks: A Playbook for Improving Your AI Agent thumbnail

Checking access…

Playback and chapters load privately for Free videos.

Matching moments

2:40 min

Reviewing live performance of self-correcting AI engineering agents

Ingo Eichhorst Ingo Eichhorst · World Congress 2026 Europe

2:28 min

Introduction to building reliable AI agents in production

Max Tkacz Max Tkacz · World Congress 2025

1:55 min

Shifting developer workloads and realistic AI productivity gains

Chris Heilmann Chris Heilmann +2 · LIVE

2:37 min

Implementing practical scrum adjustments to orchestrate AI usage correctly

Vera Slavnić Vera Slavnić · Europe 2026 Virtual

3:06 min

Key takeaways for reliable AI agent testing

Sebastian Messingfeld Sebastian Messingfeld · World Congress 2026 Europe

1:55 min

Verifying the quality of rapidly generated AI code

Krzysztof Cieślak Krzysztof Cieślak · World Congress 2026 Europe

More from World Congress 2026 North America

2026 in LLMs (so far) thumbnail
31:31
10 days ago

2026 in LLMs (so far)

Simon Willison

Running Operations Without Humans in the Loop thumbnail
32:31
11 days ago

Running Operations Without Humans in the Loop

Edward Aryee, Ryan Ries, Yaron Schneider, Chris Hallenbeck, Floriane Gramlich

Beyond the Code: Human-AI Synergies in Product Development thumbnail
17:43
11 days ago

Beyond the Code: Human-AI Synergies in Product Development

Ajita Kanchivakam Ananth

Honey, look! I vibe-coded an OS! thumbnail
30:40
11 days ago

Honey, look! I vibe-coded an OS!

Ian Smith

The Productivity Illusion: What AI Really Changed for Developers thumbnail
24:28
11 days ago

The Productivity Illusion: What AI Really Changed for Developers

Fatih Kadir Akın

Your Evals Passed. Your Agent Just Emptied a Database. thumbnail
21:37
11 days ago

Your Evals Passed. Your Agent Just Emptied a Database.

Tejas Pravinbhai Patel

Related videos

5 things I wish I hadn’t done building my AI agent thumbnail
20:16
World Congress 2026 Europe • 3 months ago

5 things I wish I hadn’t done building my AI agent

Shachar Azriel

Beyond the Benchmark: How to Evaluate AI Agents in the Real World thumbnail
30:04
World Congress 2026 Europe • 3 months ago

Beyond the Benchmark: How to Evaluate AI Agents in the Real World

Taylor Jordan Smith

What 500+ Production Environments Taught Us About Shipping AI Agents thumbnail
23:05
World Congress 2026 Europe • 3 months ago

What 500+ Production Environments Taught Us About Shipping AI Agents

Liran Hason

Agents Can't Iterate Against Tests That Lie thumbnail
29:46
World Congress 2026 North America • 11 days ago

Agents Can't Iterate Against Tests That Lie

Rocky Warren

Taming Rogue Agents: Observability-Driven Evaluation for Production Reliability thumbnail
29:12
World Congress 2026 North America • 12 days ago

Taming Rogue Agents: Observability-Driven Evaluation for Production Reliability

Anagha Rumade, Anjana Umapathy, Apoorva Jaiswal

The AI Agent Path to Prod: Building for Reliability thumbnail
30:48
World Congress 2025 • about 1 year ago

The AI Agent Path to Prod: Building for Reliability

Max Tkacz

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.