WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2026 North America • Sep 24, 2026 • Session details

Anatomy of an AI Request: Where Latency and Cost Are Really Born

Dan Fu

Running pre-fill and decode on the same GPU severely bottlenecks your AI throughput. Discover how cache-aware disaggregation and speculative decoding can drastically reduce latency and infrastructure costs.

Anatomy of an AI Request: Where Latency and Cost Are Really Born thumbnail

Checking access…

Playback and chapters load privately for Free videos.

Matching moments

5:58 min

Architecting inference layers and meta harnesses to manage token costs

Hari Lingamagunta Hari Lingamagunta +3 · World Congress 2026 North America

1:47 min

Managing compute costs and AI model routing

Deivids Vilkinsons Deivids Vilkinsons +3 · World Congress 2026 Europe

3:20 min

Optimizing AI infrastructure from applications to GPU kernels

Erran Berger Erran Berger +1 · World Congress 2026 North America

1:52 min

Prioritizing developer user experience over raw model parameters

Neel Sundaresan Neel Sundaresan +1 · World Congress 2026 Europe

2:37 min

Understanding core parameters and mechanics of large language models

Julián Duque Julián Duque · World Congress 2025

1:47 min

Balancing scale and architecture in artificial intelligence development

Yuval Dvir Yuval Dvir · World Congress 2026 North America

More from World Congress 2026 North America

2026 in LLMs (so far) thumbnail
31:31
10 days ago

2026 in LLMs (so far)

Simon Willison

Running Operations Without Humans in the Loop thumbnail
32:31
10 days ago

Running Operations Without Humans in the Loop

Edward Aryee, Ryan Ries, Yaron Schneider, Chris Hallenbeck, Floriane Gramlich

Beyond the Code: Human-AI Synergies in Product Development thumbnail
17:43
10 days ago

Beyond the Code: Human-AI Synergies in Product Development

Ajita Kanchivakam Ananth

Honey, look! I vibe-coded an OS! thumbnail
30:40
10 days ago

Honey, look! I vibe-coded an OS!

Ian Smith

The Productivity Illusion: What AI Really Changed for Developers thumbnail
24:28
10 days ago

The Productivity Illusion: What AI Really Changed for Developers

Fatih Kadir Akın

Your Evals Passed. Your Agent Just Emptied a Database. thumbnail
21:37
10 days ago

Your Evals Passed. Your Agent Just Emptied a Database.

Tejas Pravinbhai Patel

Related videos

Compute for your AI model: GPUs, LPUs, TPUs and beyond.. thumbnail
24:02
World Congress 2026 North America • 12 days ago

Compute for your AI model: GPUs, LPUs, TPUs and beyond..

Kushaagra Goyal

A Hands-On Developer Guide to Inference Engineering thumbnail
30:18
World Congress 2026 North America • 11 days ago

A Hands-On Developer Guide to Inference Engineering

Ankit Patel, Philip Kiely

Tour de Force: Open-Source LLM Inference Optimization from Simple to Sophisticated thumbnail
30:40
World Congress 2026 Europe • 3 months ago

Tour de Force: Open-Source LLM Inference Optimization from Simple to Sophisticated

Christin Pohl

The Unit Economics of AI thumbnail
29:56
World Congress 2026 North America • 11 days ago

The Unit Economics of AI

Ed Huang, Jeremy Murray, John Malcolm, Aaron Bawcom, Matt Burns

KV Cache Is Not About Speed: It's About Surviving Inference Costs thumbnail
25:52
World Congress 2026 North America • 12 days ago

KV Cache Is Not About Speed: It's About Surviving Inference Costs

David vonThenen

Efficient deployment and inference of GPU-accelerated LLMs​ thumbnail
23:01
World Congress 2024 • about 2 years ago

Efficient deployment and inference of GPU-accelerated LLMs​

Adolf Hohl

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.