WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2026 Europe • Jul 10, 2026 • Session details

LLMs in the wild: Building an AI agent that survives production

Steven Mi , Giampaolo Casolla

Stop letting prompt tweaks break your production AI. Learn how GetYourGuide used test-driven development and rigorous CI/CD evaluations to safely deploy over 150 prompt modifications.

Pause
Mute Enter Fullscreen
#1 about 3 min

Navigating the gap between prototype and production

Exploring the common challenge of migrating language model prompts to predictable behaviors in production systems.

#2 about 3 min

Motivation for introducing a conversational discovery agent

How changes in the search landscape and user preferences drove the need for automated travel discovery.

#3 about 2 min

Extracting complex semantic intent from user queries

Transforming unstructured and highly constrained travel plans into parseable criteria for backend services.

#4 about 3 min

Moving from API wrappers to agentic orchestration

Orchestrating states locally to improve performance and prevent data leakage observed in platform API wrappers.

#5 about 6 min

Architecting the multi-step travel discovery pipeline

Breaking the discovery journey into specific intent, planning, retrieval, relevance, and drafting components.

#6 about 2 min

Optimizing inference latency and node failure resilience

Implementing fan-out parallelization, fallback paths, and varying model complexities to reduce processing overhead.

#7 about 4 min

Preventing feature regression using test-driven development

How continuous prompt iterations lead to edge case failures without a rigorous evaluation framework.

#8 about 3 min

Designing concrete metrics for deterministic component evaluations

Crafting handcrafted input targets specifying expected fields, explicit null values, and routing logic flags.

#9 about 4 min

Automating regression checks in continuous integration loops

Triggering automated tests with a pass-at-k strategy to confidently merge iterations of variable models.

#10 about 2 min

Key takeaways for reliable production agent integrations

Integrating rigorous deterministic tests from inception and prioritizing system-grade development for feature deployments.

#11 about 2 min

Tooling and language coverage in question responses

Discussing the application of specific observation frameworks and processing inputs in numerous global languages.

Matching moments

3:26 min

Introducing LLMs as judges for automated testing

Sebastian Messingfeld Sebastian Messingfeld · WWC Europe 2026

2:21 min

Transitioning from AI co-pilots to AI-native products

Jordan Tigani Jordan Tigani · WWC Europe 2026

1:12 min

Enhancing conversational intent through modern large language models

Nathaniel Okenwa Nathaniel Okenwa · WWC 2025

1:36 min

Differentiating AI search layers from standard LLMs

Klaus-M. Schremser Klaus-M. Schremser · WWC Europe 2026

5:30 min

Building components of a real-world LLM lifecycle

Maxim Salnikov Maxim Salnikov · LIVE

1:39 min

Leveraging generative AI and agents for executive productivity

Katrin Lehmann Katrin Lehmann +1 · Coffee With Developers

More from World Congress 2026 Europe

Building the Nervous System of AI - Michael Kagan (NVIDIA) thumbnail
29:17
about 1 month ago

Building the Nervous System of AI - Michael Kagan (NVIDIA)

Michael Kagan, Sead Ahmetović

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote thumbnail
19:41
about 1 month ago

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote

Christian Heilmann

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend thumbnail
32:06
about 1 month ago

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend

David vonThenen

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes thumbnail
35:13
about 1 month ago

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes

Irina Branovic

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬 thumbnail
24:23
about 1 month ago

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬

Jeremy Murray

Angstfreude - AI and Corporate Culture - The Thrill and the Threat thumbnail
30:26
about 1 month ago

Angstfreude - AI and Corporate Culture - The Thrill and the Threat

Axel Ebert, Karin Krobath

Upcoming sessions on this topic

Open session

World Congress 2026 North America

No Single Model to Rule Them All: Building Resilient AI Agents Across Open & Closed LLMs

Emmanuel Acheampong

Senior Manager Developer Relations at Crusoe AI

Emmanuel Acheampong
Open session

World Congress 2026 North America

DeepAgents: Build Multi-Agent AI Systems That Actually Work

Anjana Umapathy, Apoorva Jaiswal, Anagha Rumade

Anjana Umapathy
Apoorva Jaiswal
Anagha Rumade
Open session

World Congress 2026 North America

Agents That Own Their Inference: Building Production AI Agents on Dedicated GPUs

Duan Lightfoot

Sr. AI Engineer, Akamai

Duan Lightfoot
Open session

World Congress 2026 North America

Closing the Visibility Gap: Lessons from Safety Critical Agentic Systems

Vivek Pandit

Principal Engineer at Cadence

Vivek Pandit
Open session

World Congress 2026 North America

Reinventing Testing Practices in the AI Era

Eric Deandrea

Java Champion & Senior Principal Software Engineer, IBM

Eric Deandrea
Open session

World Congress 2026 North America

AI Agents are Only as Smart as their Context: Building a Real-Time Context Engine at Intuit

Bharat Patel

Lead Software Engineer at Intuit

Bharat Patel

Related videos

How to Avoid LLM Pitfalls - Mete Atamel and Guillaume Laforge thumbnail
42:26
Coffee With Developers • over 1 year ago

How to Avoid LLM Pitfalls - Mete Atamel and Guillaume Laforge

Meta Atamel, Guillaume Laforge

Lessons Learned Building a GenAI Powered App thumbnail
30:07
WWC 2024 • almost 2 years ago

Lessons Learned Building a GenAI Powered App

Mete Atamel

Three years of putting LLMs into Software - Lessons learned thumbnail
26:30
WWC 2025 • 12 months ago

Three years of putting LLMs into Software - Lessons learned

Simon A.T. Jiménez

Why LLMs Need Observability and How to Do It thumbnail
32:41
Europe 2026 Virtual • about 1 month ago

Why LLMs Need Observability and How to Do It

Rahul Gupta

What 500+ Production Environments Taught Us About Shipping AI Agents thumbnail
23:05
WWC Europe 2026 • about 1 month ago

What 500+ Production Environments Taught Us About Shipping AI Agents

Liran Hason

Testing AI Agents: Automated Evaluation for Chatbots & RAG Systems thumbnail
30:34
WWC Europe 2026 • about 1 month ago

Testing AI Agents: Automated Evaluation for Chatbots & RAG Systems

Sebastian Messingfeld

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.