> Markdown version of [/events/world-congress-2025/sessions/625-self-hosted-llms](https://www.wearedevelopers.com/events/world-congress-2025/sessions/625-self-hosted-llms). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Self-Hosted LLMs: From Zero to Inference


- **Date:** Thursday, Jul 10, 2025
- **Time:** 14:50–15:20 (30 min)
- **Room:** Stage 6 - Red Hat
- **Event:** World Congress 2025

## Recording

[Watch recording](https://www.wearedevelopers.com/videos/1597-self-hosted-llms-from-zero-to-inference)

## Description

As large language models (LLMs) become more accessible, running them locally unlocks exciting opportunities for developers, engineers, and privacy-focused users. Why rely on costly cloud AI services that share your data when you could deploy your own models tailored to your needs? In this session, we'll dive into the advantages of local LLM deployment, from selecting the right open source model to optimizing performance on consumer hardware and integrating with your unique data. Let's explore the journey to your own local stack for AI, and cover the important technical details such as model quantization, API integrations with IDE code assistants, and advanced methods like Retrieval-Augmented Generation (RAG) to connect your LLM to private data sources. Don't miss out on the fun live demos that prove the bright future of open source AI is already here!

## Speakers

### [Cedric Clyburn](https://www.wearedevelopers.com/@cedric-clyburn)

Senior Developer Advocate, Red Hat
### [Roberto Carratalá](https://www.wearedevelopers.com/@roberto-carratala)

Principal AI Architect at Red Hat


## Related talks at this congress

- [LLM Local Inference: Tools, Techniques, and Insights](https://www.wearedevelopers.com/events/world-congress-2025/sessions/854-llm-local-inference) — Riccardo Zoncada
- [Exploring LLMs across clouds](https://www.wearedevelopers.com/events/world-congress-2025/sessions/525-exploring-llms) — Tomislav Tipurić
- [Inside the Mind of an LLM](https://www.wearedevelopers.com/events/world-congress-2025/sessions/831-inside-the-mind-of) — Emanuele Fabbiani
- [Adding knowledge to open-source LLMs](https://www.wearedevelopers.com/events/world-congress-2025/sessions/734-adding-knowledge-to) — Harshita Seth, Sergio Perez