The New Bottleneck in Software Development
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
The KV cache is the new memory bottleneck crippling generative AI applications. Learn how modern architectures like Grouped-Query Attention overcome this limit to optimize your production workloads.
Checking access…
Playback and chapters load privately for Free videos.
Matching moments
More from World Congress 2026 North America
Upcoming sessions on this topic
Starts in 5 days
Conference India 2026
November 25–26, 2026
Bengaluru, India
-
Bypassing the GPU Tax: Smart Layer-7 Routing with Small Language Models (SLMs)
Sagar Utekar · CrowdStrike
Thu 26 Nov · Stage 2
-
Recursive Language Models: Scaling infinitely beyond the Context Window
Jayita Bhattacharyya · Domyn
Thu 26 Nov · Stage 3 - powered by GitHub
-
How 8 GPUs Became 16: Rethinking LLM Inference Through Parallelism, Memory, and Runtime Design
Purnima Kumari · DigitalOCean
Thu 26 Nov · Stage 2
Related videos
Related articles
From learning to earning
Jobs that call for the skills explored in this talk.
5 days ago
Lead Engineer, Google Cloud
PwC
Atlanta, GA, United States
Expert
$99k–232k
LangChain
Google Cloud
Generative AI
7 days ago
Lead Engineer, Google Cloud
PwC
Boca Raton, FL, United States
Expert
$99k–232k
LangChain
Google Cloud
Generative AI
5 days ago
Lead Engineer, Google Cloud
PwC
Toledo, OH, United States
Expert
$99k–232k
LangChain
Google Cloud
Generative AI
17 days ago
Senior Engineer, Google Cloud
PwC
Richmond, VA, United States
Expert
$77k–202k
LangChain
Google Cloud
Spring Cloud
17 days ago
Senior Engineer, Google Cloud
PwC
Las Vegas, NV, United States
Expert
$77k–202k
LangChain
Google Cloud
Spring Cloud
17 days ago
Senior Engineer, Google Cloud
PwC
Detroit, MI, United States
Expert
$77k–202k
LangChain
Google Cloud
Spring Cloud