Fast, Cheap, and Accurate: Optimizing LLM Inference with vLLM and Quantization
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Struggling to balance cost, accuracy, and latency in your LLM deployments? Discover how vLLM and quantization can slash your VRAM needs by 50% without sacrificing performance.
Starting at 25:36 · Watch from the beginning
Checking access…
Playback and chapters load privately for Free videos.
Matching moments
More from World Congress 2026 North America
Upcoming sessions on this topic
Starts in 5 days
Conference India 2026
November 25–26, 2026
Bengaluru, India
-
How 8 GPUs Became 16: Rethinking LLM Inference Through Parallelism, Memory, and Runtime Design
Purnima Kumari · DigitalOCean
Thu 26 Nov · Stage 2
-
Bypassing the GPU Tax: Smart Layer-7 Routing with Small Language Models (SLMs)
Sagar Utekar · CrowdStrike
Thu 26 Nov · Stage 2
Related videos
From learning to earning
Jobs that call for the skills explored in this talk.
5 days ago
Lead Engineer, Google Cloud
PwC
Atlanta, GA, United States
Expert
$99k–232k
LangChain
Google Cloud
Generative AI
7 days ago
Lead Engineer, Google Cloud
PwC
Boca Raton, FL, United States
Expert
$99k–232k
LangChain
Google Cloud
Generative AI
7 days ago
Senior AI Scientist - Model Training & Architecture
BWI GmbH
Hamburg, Germany
Expert
€87k–113k
NoSQL
QLoRA
Docker
5 days ago
Lead Engineer, Google Cloud
PwC
Toledo, OH, United States
Expert
$99k–232k
LangChain
Google Cloud
Generative AI
17 days ago
Senior Engineer, Google Cloud
PwC
Richmond, VA, United States
Expert
$77k–202k
LangChain
Google Cloud
Spring Cloud
17 days ago
Senior Engineer, Google Cloud
PwC
Atlanta, GA, United States
Expert
$77k–202k
LangChain
Google Cloud
Spring Cloud