> Markdown version of [/events/world-congress-2026-europe/sessions/983-owning-the-inference](https://www.wearedevelopers.com/events/world-congress-2026-europe/sessions/983-owning-the-inference). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Owning the Inference Layer: When and How to Run your Own Models


- **Date:** Thursday, Jul 9, 2026
- **Time:** 10:10–10:40 (30 min)
- **Room:** Stage 8 - powered by Red Hat
- **Event:** World Congress 2026 Europe

## Description

Hosted model APIs are the fastest way to start building with Gen AI models, but they are not always the best long-term fit. As workloads grow, teams start running into harder questions around latency, cost, deployment flexibility, data boundaries, and performance tuning. This talk looks at what changes when you move from calling a hosted model API to running inference yourself. We’ll break down the practical tradeoffs between hosted and self-hosted approaches, then examine how modern open inference technologies such as vLLM and llm-d are making self-hosted AI more realistic for production systems. Rather than treating this as a debate between two camps, the session focuses on decision-making: when self-hosting is worth the added operational complexity, when hosted APIs still win, and what teams take on when they choose to own the inference layer. You’ll leave with a practical framework for evaluating cost, control, performance, and architectural fit in your own environment.

## Speaker

### [Taylor Jordan Smith](https://www.wearedevelopers.com/@taylor-jordan-smith)

Senior AI Developer Advocate at Red Hat


## Related talks at this congress

- [Tour de Force: Open-Source LLM Inference Optimization from Simple to Sophisticated](https://www.wearedevelopers.com/events/world-congress-2026-europe/sessions/1094-tour-de-force-open) — Christin Pohl
- [Agents That Own Their Inference: Building Production AI Agents on Dedicated GPUs](https://www.wearedevelopers.com/events/world-congress-2026-europe/sessions/1350-agents-that-own) — Duan Lightfoot
- [The 8th Layer: Building the Open AI Stack Before It Builds You](https://www.wearedevelopers.com/events/world-congress-2026-europe/sessions/1067-the-8th-layer) — Raffi Krikorian
- [Fine-Tuning Small Language Models for Agentic AI](https://www.wearedevelopers.com/events/world-congress-2026-europe/sessions/1389-fine-tuning-small) — Björn Buchhold