LLMs in the wild: Building an AI agent that survives production
-
Steven Mi
GetYourGuide
Senior MLOps Engineer
-
Giampaolo Casolla
GetYourGuide
Senior Data Scientist
Building AI agents that process legal documents with 10,000+ pages requires more than throwing context at an LLM. This talk dissects our production event-driven architecture.
Youโll learn: - Why synchronous LLM calls fail at legal document scale - the cold start and a timeout problem - Event-driven orchestration patterns for multi-step agent workflows (planning, dynamic loading, context assembly) - Long-context chunking strategies that preserve legal reasoning chains - Cost optimization: how we reduced per-request costs 73% through intelligent caching and selective context loading - Production failure modes: what breaks when agents plan incorrectly
Concrete architecture, real metrics, battle-tested patterns. No theoretical frameworks - this is what actually runs in production, processing legal contracts for 10M+ users.
World Congress 2026 Europe
Steven Mi
GetYourGuide
Senior MLOps Engineer
Giampaolo Casolla
GetYourGuide
Senior Data Scientist
Edvin Teskeredzic
Infobip
Senior AI Software Engineer
Luise Freese
m365princess
Architect
Viktoria Semaan
databricks
Principal AI Evangelist