> Markdown version of [/events/world-congress-2026-europe/sessions/1142-faster-together](https://www.wearedevelopers.com/events/world-congress-2026-europe/sessions/1142-faster-together). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Faster Together: Train and Deploy a Speculative Decoding Model for Low-Latency LLM Inference


- **Date:** Thursday, Jul 9, 2026
- **Time:** 15:30–17:30 (120 min)
- **Room:** Room M2 (40 Seats)
- **Event:** World Congress 2026 Europe

## Description

Dive deep into theory and practice of low-latency inference by deploying NVIDIA TensorRT-LLM with advanced speculative decoding techniques. You'll train an Eagle-3 draft head to propose candidate tokens efficiently, serve it, and benchmark it using AIPerf to quantify how these strategies minimize latency.


Workshop Preparation:
- Please bring your own laptop.
- Please review the following document and prepare accordingly before the workshop: <https://developer.nvidia.com/dli/getready>

## Speakers

### [Amit Kushwaha](https://www.wearedevelopers.com/@amit-kushwaha)

Principal Solutions Architect, NVIDIA
### [Dmitry Mironov](https://www.wearedevelopers.com/@dmitry-mironov)

Solutions Architect, NVIDIA


## Related talks at this congress

- [Tour de Force: Open-Source LLM Inference Optimization from Simple to Sophisticated](https://www.wearedevelopers.com/events/world-congress-2026-europe/sessions/1094-tour-de-force-open) — Christin Pohl
- [Accelerating AI Inference at Scale: A Deep Dive Into NVIDIA Dynamo on Kubernetes](https://www.wearedevelopers.com/events/world-congress-2026-europe/sessions/1061-accelerating-ai) — Anshul Jindal, Mohak Chadha
- [Agents That Own Their Inference: Building Production AI Agents on Dedicated GPUs](https://www.wearedevelopers.com/events/world-congress-2026-europe/sessions/1350-agents-that-own) — Duan Lightfoot
- [The LLM Evolution: From Sequence Imitation to Verifiable Reasoning](https://www.wearedevelopers.com/events/world-congress-2026-europe/sessions/1377-the-llm-evolution) — Kamen Petroff