> Markdown version of [/videos/100472-the-new-bottleneck-in-software-development?t=61](https://www.wearedevelopers.com/videos/100472-the-new-bottleneck-in-software-development?t=61). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# The New Bottleneck in Software Development

The KV cache is the new memory bottleneck crippling generative AI applications. Learn how modern architectures like Grouped-Query Attention overcome this limit to optimize your production workloads.

- **Speakers:** [Aditya Jayaprakash](https://www.wearedevelopers.com/@aditya-jayaprakash)
- **Event:** World Congress 2026 North America
- **Published:** September 25, 2026
- **Duration:** 25:38
- **URL:** https://www.wearedevelopers.com/videos/100472-the-new-bottleneck-in-software-development
- **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/6e832aedbd8c64b2f40e7e95e4971c88/thumbnails/thumbnail.jpg?time=63287ms

## Access

Playback and chapters for this video are available with a Free account.

## Related Moments

- [Evaluating language models by understanding underlying architectural changes](https://www.wearedevelopers.com/videos/100477-understanding-llm-architectures-inside-the-design-of-modern-models) (from "Understanding LLM Architectures: Inside the Design of Modern Models")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/8d9f6a3c5249ca4b1427a44b8b479bb2/thumbnails/thumbnail.jpg?time=70527ms
- [Understanding the unique architecture of LLM applications](https://www.wearedevelopers.com/videos/100407-red-teaming-your-llm-app-a-hands-on-threat-model-you-can-reuse) (from "Red Teaming Your LLM App -- A Hands-On Threat Model You Can Reuse")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/11a820ca699b9e4474ed6156b27f8ec6/thumbnails/thumbnail.jpg?time=160868ms
- [Understanding core parameters and mechanics of large language models](https://www.wearedevelopers.com/videos/1512-building-ai-applications-with-langchain-and-node-js) (from "Building AI Applications with LangChain and Node.js")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/7f71af512c5d50d581e626e3361b8deb/thumbnails/thumbnail.jpg?time=57865ms
- [Accelerating product features using generative large language models](https://www.wearedevelopers.com/videos/100362-navigating-growth-scaling-challenges-and-office-expansions-with-david-singleton-cto-at-stripe) (from "Navigating Growth, Scaling Challenges, and Office Expansions with David Singleton, CTO at Stripe")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/cf4792c5f5db523d012a4b5b448bed7a/thumbnails/thumbnail.jpg?time=120130ms
- [Leveraging large language models for code optimization and development](https://www.wearedevelopers.com/videos/1106-the-future-of-computing-ai-technologies-in-the-exascale-era) (from "The Future of Computing: AI Technologies in the Exascale Era")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/852fc4aca18bd3af3d48ec5d5b629889/thumbnails/thumbnail.jpg?time=193385ms
- [Capabilities and applications of large language models](https://www.wearedevelopers.com/videos/1218-data-privacy-in-llms-challenges-and-best-practices) (from "Data Privacy in LLMs: Challenges and Best Practices")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/b747f91fa3062cbcaf1454c0125e5c80/thumbnails/thumbnail.jpg?time=93045ms

## Related Articles

- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering)
- [MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production](https://www.wearedevelopers.com/magazine/115-mlops-deploying-maintaining-and-evolving-machine-learning-models-in-production)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)

## Related Jobs

- [Engineering Manager, Google Cloud AI/ML](https://www.wearedevelopers.com/jobs/ext/3552533-engineering-manager-google-cloud-ai-ml) at **PwC**
- [Engineering Manager, Google Cloud AI/ML](https://www.wearedevelopers.com/jobs/ext/3530886-engineering-manager-google-cloud-ai-ml) at **PwC**
- [Engineering Manager, Google Cloud AI/ML](https://www.wearedevelopers.com/jobs/ext/3559458-engineering-manager-google-cloud-ai-ml) at **PwC**
- [Senior Engineering Manager, Google Cloud Ai/Ml](https://www.wearedevelopers.com/jobs/ext/3824402-senior-engineering-manager-google-cloud-ai-ml) at **PwC**
- [Engineering Manager, Google Cloud AI/ML](https://www.wearedevelopers.com/jobs/ext/3544382-engineering-manager-google-cloud-ai-ml) at **PwC**
- [Engineering Manager, Google Cloud AI/ML](https://www.wearedevelopers.com/jobs/ext/3554453-engineering-manager-google-cloud-ai-ml) at **PwC**