WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2025 • Aug 20, 2025 • Session details

The AI Agent Path to Prod: Building for Reliability

Max Tkacz

Stop letting probabilistic AI break your production environments. Learn how to isolate deterministic routing and treat evaluations like unit tests to deploy reliable agents at scale.

Pause
Mute Enter Fullscreen
#1 about 3 min

Introduction to building reliable AI agents in production

Overcoming the experimental nature of AI tools requires strict evaluation and testing frameworks before enterprise deployment.

#2 about 2 min

Defining realistic scopes for task-based AI agents

Focusing on narrow, specific tasks like trial extensions avoids the compounding failure rates of overly broad agent deployments.

#3 about 3 min

Mapping the path from prototype to production deployment

Moving past initial prototypes involves a structured cycle of scoping, evaluations, guardrails, and continuous monitoring.

#4 about 2 min

Structuring parent workflows and sub-workflow AI agents

Isolating webhook ingestion and data enrichment from core AI logic simplifies both independent testing and workflow maintainability.

#5 about 3 min

Executing and analyzing the core AI agent sub-workflow

Observing an agent process structured parameters reveals how underlying tool dependencies interact with the core language model.

#6 about 5 min

Running happy path evaluations to test agent consistency

Applying repetitive evaluations to standard inputs exposes hidden inconsistencies in tool selection caused by probabilistic model variance.

#7 about 4 min

Iterating on system prompts using evaluation feedback loops

Injecting explicit constraints and few-shot examples directly into the system prompt stabilizes inconsistent output formats and behavior.

#8 about 5 min

Testing edge cases and mitigating prompt injection attacks

Designing custom tests for bad actors prevents prompt injection by routing malicious manipulations to a secure human fallback.

#9 about 5 min

Implementing robust production guardrails and error handling

Building custom error fallback structures and deterministic routing logic proactively manages unpredictable downtime and protects high-value segments.

#10 about 2 min

Ensuring inference redundancy and final deployment takeaways

Configuring fallback models and intelligent routers provides the ultimate layer of stability for automated tasks in production.

Matching moments

2:43 min

Best practices for implementing reliable AI agent frameworks

Marcel Scherenberg Marcel Scherenberg · WWC 2025

3:34 min

Architecting autonomous agents for production lifecycle management

Sebastian Kister Sebastian Kister · WWC Europe 2026

2:06 min

Rethinking team structures around AI agent capabilities

Mike Mike · WWC 2025

1:59 min

Shifting from AI experimentation to real-world production

General Program · WWC Europe 2026

1:09 min

Resolving developer challenges in AI agent implementation

Ricardo Ricardo · WWC 2025

2:20 min

Best practices for deploying safe infrastructure AI agents

Alfonso Sandoval Rosas Alfonso Sandoval Rosas · Europe 2026 Virtual

More from World Congress 2025

GenAI Security: Navigating the Unseen Iceberg thumbnail
24:33
10 months ago

GenAI Security: Navigating the Unseen Iceberg

Maish Saidel-Keesing

Behind the Code: How Women Are Powering the Future of AI thumbnail
30:28
12 months ago

Behind the Code: How Women Are Powering the Future of AI

Alexandra Wudel, Laura Moritz, Madalina Florean

The AI Hype Filter: What’s Real, What’s Investable, What’s Noise? thumbnail
28:12
12 months ago

The AI Hype Filter: What’s Real, What’s Investable, What’s Noise?

Justus Lumpe, Konstantin Vinogradov, Nils Eiteneyer, Stephan Wirris

AI in Leadership: How Technology is Reshaping Executive Roles thumbnail
28:19
12 months ago

AI in Leadership: How Technology is Reshaping Executive Roles

Bernd Datler, Jasmin Kaiser, Jeff Hausmann, Sonja Alvarez

The AI-Ready Stack: Rethinking the Engineering Org of the Future thumbnail
28:09
12 months ago

The AI-Ready Stack: Rethinking the Engineering Org of the Future

Alex Laubscher, Jan Oberhauser, Keno Dreßel, Mirko Novakovic

AI Sovereignty: What Does It Take? thumbnail
29:13
12 months ago

AI Sovereignty: What Does It Take?

Boris Hecker, Clemens Wasner, Robin Hermann, Sonja Alvarez

Upcoming sessions on this topic

Open session

World Congress 2026 North America

Closing the Visibility Gap: Lessons from Safety Critical Agentic Systems

Vivek Pandit

Principal Engineer at Cadence

Vivek Pandit
Open session

World Congress 2026 North America

Designing APIs That Survive AI Agents at Scale

Phani Pendurthi

Mastercard, Principal Software Engineer

Phani Pendurthi
Open session

World Congress 2026 North America

Agents Can't Iterate Against Tests That Lie

Rocky Warren

Senior Staff Software Engineer at Clipboard

Rocky Warren
Open session

World Congress 2026 North America

Evals Are Infra: Building AI Systems Developers Can Actually Trust

Phoebe Wang

Member of Technical Staff at OpenAI

Phoebe Wang
Open session

World Congress 2026 North America

Securing AI Agent Infrastructure: Identity, Attestation, and Trust at Scale

Abdel Fane

Founder of OpenA2A

Abdel Fane
Open session

World Congress 2026 North America

AI-Powered Incident Triage: How We Built GenAI Agents with MCPs to Automate On-Call Workflows

Prakshal Doshi

Site Reliability Engineer

Prakshal Doshi

Related videos

Beyond the Benchmark: How to Evaluate AI Agents in the Real World thumbnail
30:04
WWC Europe 2026 • about 1 month ago

Beyond the Benchmark: How to Evaluate AI Agents in the Real World

Taylor Jordan Smith

Running AI at Scale: The Secret Ingredients thumbnail
30:04
WWC Europe 2026 • about 1 month ago

Running AI at Scale: The Secret Ingredients

Boris Hecker, Max Tschochohei, Peter Kürpick, Tomislav Tipurić

Why Most AI Features Fail After the Demo thumbnail
31:15
Europe 2026 Virtual • about 1 month ago

Why Most AI Features Fail After the Demo

Akshay Nagpal

Building Agents Securely at Scale - Alfonso Graziano thumbnail
31:49
Coffee With Developers • 4 months ago

Building Agents Securely at Scale - Alfonso Graziano

Alfonso Graziano

The Last Mile of AI: From Prototype to Production thumbnail
28:23
WWC Europe 2026 • about 1 month ago

The Last Mile of AI: From Prototype to Production

Clemens Wasner, Holger Hammel, Martin Remmelgas, Max Jacobson, Marius Cosareanu

What Production Knows: Closing the Loop Between AI Agents and the Systems They Build thumbnail
26:33
WWC Europe 2026 • about 1 month ago

What Production Knows: Closing the Loop Between AI Agents and the Systems They Build

May Walter

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.