> Markdown version of [/events/world-congress-2026-north-america/sessions/1771-a-hands-on-developer](https://www.wearedevelopers.com/events/world-congress-2026-north-america/sessions/1771-a-hands-on-developer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# A Hands-On Developer Guide to Inference Engineering


- **Event:** World Congress 2026 North America

## Description

Inference engineers solve a multi-dimensional puzzle across latency, throughput, and cost to serve generative AI models. Spanning interdependent layers of the serving stack, from CUDA to runtimes to containers to Kubernetes, inference engineering is the discipline behind scaling AI applications. In this session, we'll cover key inference engineering concepts across both runtime and infrastructure, including topology-aware model parallelism, prefill-decode disaggregated serving, KV-aware routing, autoscaling strategies, and multi-cluster infrastructure management, with a focus on the work required to run multi-trillion-parameter LLMs efficiently in production.

## Speakers

### [Ankit Patel](https://www.wearedevelopers.com/@ankit-patel)

VP of Developer Ecosystem at NVIDIA
### [Philip Kiely](https://www.wearedevelopers.com/@philip-kiely)

Special Projects at Baseten


## Related talks at this congress

- [Agents That Own Their Inference: Building Production AI Agents on Dedicated GPUs](https://www.wearedevelopers.com/events/world-congress-2026-north-america/sessions/1717-agents-that-own) — Duan Lightfoot
- [Trust, But Verify: Continuous GPU Validation at Scale](https://www.wearedevelopers.com/events/world-congress-2026-north-america/sessions/1690-trust-but-verify) — Kyle Bell
- [You Can’t Re-Run Sunlight: Designing ML Data Architectures for Physical AI](https://www.wearedevelopers.com/events/world-congress-2026-north-america/sessions/1677-you-can-t-re-run) — An Phan
- [KV Cache Is Not About Speed: It's About Surviving Inference Costs](https://www.wearedevelopers.com/events/world-congress-2026-north-america/sessions/1668-kv-cache-is-not) — David vonThenen

## Watch remotely

Can’t make it to San José? Watch this session live with Pro. You also get:

- All full videos, bookmarks, and playlists
- World Congress livestreams

[See pricing](https://www.wearedevelopers.com/pricing)

## Links

- [Get tickets](https://www.wearedevelopers.com/world-congress-north-america/tickets)