> Markdown version of [/events/world-congress-2026-north-america/sessions/1415-fast-cheap-and](https://www.wearedevelopers.com/events/world-congress-2026-north-america/sessions/1415-fast-cheap-and). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Fast, Cheap, and Accurate: Optimizing LLM Inference with vLLM and Quantization


- **Event:** World Congress 2026 North America

## Description


Running large language models at scale can get expensive fast, but the right optimizations can cut latency and GPU costs dramatically.

We’ll walk through how to serve models efficiently using vLLM, an open-source, high-performance inference engine. Then and generate and test quantized models, expose them through vLLM’s OpenAI-compatible API, and tune runtime flags to balance throughput, latency, and accuracy on different GPUs.

We’ll benchmark performance live, inspect token-throughput metrics, and discuss real-world deployment trade-offs.

## Speakers

### [Legare Kerrison](https://www.wearedevelopers.com/@technicallylegare)

AI Developer Advocate at Red Hat
### [Cedric Clyburn](https://www.wearedevelopers.com/@cedric-clyburn)

Senior Developer Advocate at Red Hat


## Related talks at this congress

- [Understanding LLM Architectures: Inside the Design of Modern Models](https://www.wearedevelopers.com/events/world-congress-2026-north-america/sessions/1669-understanding-llm) — Jofia Jose Prakash
- [KV Cache Is Not About Speed: It's About Surviving Inference Costs](https://www.wearedevelopers.com/events/world-congress-2026-north-america/sessions/1668-kv-cache-is-not) — David vonThenen
- [No Single Model to Rule Them All: Building Resilient AI Agents Across Open & Closed LLMs](https://www.wearedevelopers.com/events/world-congress-2026-north-america/sessions/1671-no-single-model-to) — Emmanuel Acheampong
- [Agents That Own Their Inference: Building Production AI Agents on Dedicated GPUs](https://www.wearedevelopers.com/events/world-congress-2026-north-america/sessions/1717-agents-that-own) — Duan Lightfoot

## Watch remotely

Can’t make it to San José? Watch this session live with Pro. You also get:

- All full videos, bookmarks, and playlists
- World Congress livestreams

[See pricing](https://www.wearedevelopers.com/pricing)

## Links

- [Get tickets](https://www.wearedevelopers.com/world-congress-north-america/tickets)