WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2026 North America • Sep 26, 2026 • Session details

21 Experiments in Six Weeks: A Playbook for Improving Your AI Agent

Sofia Rest

Think upgrading to a smarter model automatically improves your AI agent? Sentry ran 21 A/B tests in six weeks and discovered that more expensive models can actually hurt performance.

21 Experiments in Six Weeks: A Playbook for Improving Your AI Agent thumbnail

Checking access…

Playback and chapters load privately for Free videos.

Matching moments

2:40 min

Reviewing live performance of self-correcting AI engineering agents

Ingo Eichhorst Ingo Eichhorst · World Congress 2026 Europe

2:28 min

Introduction to building reliable AI agents in production

Max Tkacz Max Tkacz · World Congress 2025

1:55 min

Shifting developer workloads and realistic AI productivity gains

Chris Heilmann Chris Heilmann +2 · LIVE

2:37 min

Implementing practical scrum adjustments to orchestrate AI usage correctly

Vera Slavnić Vera Slavnić · Europe 2026 Virtual

3:06 min

Key takeaways for reliable AI agent testing

Sebastian Messingfeld Sebastian Messingfeld · World Congress 2026 Europe

1:55 min

Verifying the quality of rapidly generated AI code

Krzysztof Cieślak Krzysztof Cieślak · World Congress 2026 Europe

More from World Congress 2026 North America

2026 in LLMs (so far) thumbnail
31:31
about 1 month ago

2026 in LLMs (so far)

Simon Willison

Running Operations Without Humans in the Loop thumbnail
32:31
about 1 month ago

Running Operations Without Humans in the Loop

Edward Aryee, Ryan Ries, Yaron Schneider, Chris Hallenbeck, Floriane Gramlich

Beyond the Code: Human-AI Synergies in Product Development thumbnail
17:43
about 1 month ago

Beyond the Code: Human-AI Synergies in Product Development

Ajita Kanchivakam Ananth

Honey, look! I vibe-coded an OS! thumbnail
30:40
about 1 month ago

Honey, look! I vibe-coded an OS!

Ian Smith

The Productivity Illusion: What AI Really Changed for Developers thumbnail
24:28
about 1 month ago

The Productivity Illusion: What AI Really Changed for Developers

Fatih Kadir Akın

Your Evals Passed. Your Agent Just Emptied a Database. thumbnail
21:37
about 1 month ago

Your Evals Passed. Your Agent Just Emptied a Database.

Tejas Pravinbhai Patel

Upcoming sessions on this topic

Open session

Teaching AI Coding Agents to Build It Right the First Time

  • Sajeetharan Sinnathurai

    Microsoft

    Principal Product Manager

Open session

Autopsy of an Autonomous Incident: When the Agent Made It Worse

  • Navin Pai

    StackGen

    Director of Engineering

Open session

Beware of Strangers Bearing Code: Open Source Trust in the Agent Era

  • Vikram Vaswani

    Consultant

Open session

AI Is the Easy Part: Why Faster Engineers Don't Make Faster Businesses

  • Bharat Sharma

    Booking

    Senior Engineering Manager

Open session

Build a Zero-Cost AI Agent in Your Browser

  • Aishwarya Mathuria

    Adobe

    Computer Scientist

  • Nishant Thakur

    Adobe

    Senior Computer Scientist

Open session

How is SWE & EM roles are changing in the age of AI

  • Amol Sharma

    Stripe

    Engineering Manager

Related videos

5 things I wish I hadn’t done building my AI agent thumbnail
20:16
World Congress 2026 Europe • 4 months ago

5 things I wish I hadn’t done building my AI agent

Shachar Azriel

Beyond the Benchmark: How to Evaluate AI Agents in the Real World thumbnail
30:04
World Congress 2026 Europe • 4 months ago

Beyond the Benchmark: How to Evaluate AI Agents in the Real World

Taylor Jordan Smith

What 500+ Production Environments Taught Us About Shipping AI Agents thumbnail
23:05
World Congress 2026 Europe • 4 months ago

What 500+ Production Environments Taught Us About Shipping AI Agents

Liran Hason

Agents Can't Iterate Against Tests That Lie thumbnail
29:46
World Congress 2026 North America • about 1 month ago

Agents Can't Iterate Against Tests That Lie

Rocky Warren

Taming Rogue Agents: Observability-Driven Evaluation for Production Reliability thumbnail
29:12
World Congress 2026 North America • about 1 month ago

Taming Rogue Agents: Observability-Driven Evaluation for Production Reliability

Anagha Rumade, Anjana Umapathy, Apoorva Jaiswal

The AI Agent Path to Prod: Building for Reliability thumbnail
30:48
World Congress 2025 • about 1 year ago

The AI Agent Path to Prod: Building for Reliability

Max Tkacz

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.