World Congress 2026 North America • Sep 25, 2026 • Session details

A Hands-On Developer Guide to Inference Engineering

Ankit Patel, Philip Kiely

Scaling web apps once meant serving kilobytes of HTML. Today, inference engineers orchestrate terabytes of model weights and gigabytes of KV cache to deploy high-throughput generative AI.

A Hands-On Developer Guide to Inference Engineering thumbnail

Checking access…

Playback and chapters load privately for Free videos.

Matching moments

5:58 min

Architecting inference layers and meta harnesses to manage token costs

Hari Lingamagunta Hari Lingamagunta +3 · World Congress 2026 North America

50 sec

Key takeaways for optimizing open source inference engine deployments

Legare Kerrison Legare Kerrison +1 · World Congress 2026 North America

1:52 min

Prioritizing developer user experience over raw model parameters

Neel Sundaresan Neel Sundaresan +1 · World Congress 2026 Europe

2:54 min

Optimizing infrastructure for agentic flows and inference

Michael Kagan Michael Kagan +1 · World Congress 2026 Europe

1:20 min

Engineering lessons for scaling high-performance AI infrastructure

Wayne Liu Wayne Liu · World Congress 2026 North America

1:24 min

Exploring open source inference tools for language model serving

Legare Kerrison Legare Kerrison +1 · World Congress 2026 North America

Upcoming sessions on this topic

Starts in 5 days

Conference India 2026

November 25–26, 2026

Bengaluru, India