From Model Selection to Smart Routing: How to Use the Right LLM for Every Task
What this session covers
No single AI model is best at everything. The challenge is knowing which model to use, how to measure whether it is good enough, and how to control cost as agents move across different tasks. You’ll learn how to: Compare proprietary, open-weight, and fine-tuned models for different workloads Evaluate models on quality, latency, and cost using LLM judges Use Smart Routing to automatically match tasks and agent subtasks to the right model Govern agent workflows with policies, token limits, and spending controls This session includes practical demos of model evaluation, Smart Routing, and agent cost controls with the open-source tools Omnigent and MLflow. Whether you’re building AI applications or coding agents, you’ll leave with a practical framework for choosing, evaluating, and governing models without sacrificing quality.
World Congress 2026 North America
Related talks
- Architecting the 100X SDLC: Building Production Trust into AI-Assisted Delivery
Ranjan Parthasarathy · AXIOMSTUDIO.AI
Thu 24 Sep · Outdoor Stage
- Beyond Vibe Coding: Using CLI Tools as Your AI Counterpart in Pair Programming
Ron Veen · Team Rockstars IT
Thu 24 Sep · Stage 7
- Beyond the Code: Human-AI Synergies in Product Development
Ajita Kanchivakam Ananth · Google
Fri 25 Sep · Outdoor Stage