> Markdown version of [/videos/100542-a-hands-on-developer-guide-to-inference-engineering?t=313](https://www.wearedevelopers.com/videos/100542-a-hands-on-developer-guide-to-inference-engineering?t=313). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# A Hands-On Developer Guide to Inference Engineering

Scaling web apps once meant serving kilobytes of HTML. Today, inference engineers orchestrate terabytes of model weights and gigabytes of KV cache to deploy high-throughput generative AI.

- **Speakers:** [Ankit Patel](https://www.wearedevelopers.com/@ankit-patel), [Philip Kiely](https://www.wearedevelopers.com/@philip-kiely)
- **Event:** World Congress 2026 North America
- **Published:** September 25, 2026
- **Duration:** 30:18
- **URL:** https://www.wearedevelopers.com/videos/100542-a-hands-on-developer-guide-to-inference-engineering
- **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/2b51b1c6b13269bea497b26887eb9a26/thumbnails/thumbnail.jpg?time=315094ms

## Access

Playback and chapters for this video are available with a Free account.

## Related Moments

- [Architecting inference layers and meta harnesses to manage token costs](https://www.wearedevelopers.com/videos/100600-inside-the-ai-native-engineering-org) (from "Inside the AI-Native Engineering Org")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/ffe256ba71a3d5017d4ff5d033858092/thumbnails/thumbnail.jpg?time=242411ms
- [Key takeaways for optimizing open source inference engine deployments](https://www.wearedevelopers.com/videos/100416-fast-cheap-and-accurate-optimizing-llm-inference-with-vllm-and-quantization) (from "Fast, Cheap, and Accurate: Optimizing LLM Inference with vLLM and Quantization")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/abcb8db1da8e8e150daf29c9b35f20ea/thumbnails/thumbnail.jpg?time=87941ms
- [Prioritizing developer user experience over raw model parameters](https://www.wearedevelopers.com/videos/100256-can-this-elephant-dance-ibm-bob-and-the-future-of-ai-first-software-development) (from "Can This Elephant Dance? IBM Bob and the Future of AI-First Software Development")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/d9f8cc0d9bbcac0ba21727a7959aa947/thumbnails/thumbnail.jpg?time=65750ms
- [Optimizing infrastructure for agentic flows and inference](https://www.wearedevelopers.com/videos/2133-building-the-nervous-system-of-ai-michael-kagan-nvidia) (from "Building the Nervous System of AI - Michael Kagan (NVIDIA)")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/b16a2611a869e14efda647cc928adf55/thumbnails/thumbnail.jpg?time=73480ms
- [Engineering lessons for scaling high-performance AI infrastructure](https://www.wearedevelopers.com/videos/100365-designing-high-performance-ai-apis-lessons-from-serving-millions-of-real-time-requests) (from "Designing High-Performance AI APIs: Lessons from Serving Millions of Real-Time Requests")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/fe4185821ca4ab9be4b685ceb76ff6bf/thumbnails/thumbnail.jpg?time=408535ms
- [Exploring open source inference tools for language model serving](https://www.wearedevelopers.com/videos/100416-fast-cheap-and-accurate-optimizing-llm-inference-with-vllm-and-quantization) (from "Fast, Cheap, and Accurate: Optimizing LLM Inference with vLLM and Quantization")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/abcb8db1da8e8e150daf29c9b35f20ea/thumbnails/thumbnail.jpg?time=87941ms

## Related Articles

- [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering)
- [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it)

## Related Jobs

- [Senior Engineer, Google Cloud](https://www.wearedevelopers.com/jobs/ext/4564731-senior-engineer-google-cloud) at **PwC**
- [Senior Engineer, Google Cloud](https://www.wearedevelopers.com/jobs/ext/4566133-senior-engineer-google-cloud) at **PwC**
- [Senior Engineer, Google Cloud](https://www.wearedevelopers.com/jobs/ext/4562006-senior-engineer-google-cloud) at **PwC**
- [Senior Engineer, Google Cloud](https://www.wearedevelopers.com/jobs/ext/4558422-senior-engineer-google-cloud) at **PwC**
- [Senior Engineer, Google Cloud](https://www.wearedevelopers.com/jobs/ext/4566395-senior-engineer-google-cloud) at **PwC**
- [Senior Engineer, Google Cloud](https://www.wearedevelopers.com/jobs/ext/4571507-senior-engineer-google-cloud) at **PwC**