World Congress 2025 • Aug 20, 2025 • Session details

Self-Hosted LLMs: From Zero to Inference

Cedric Clyburn, Roberto Carratalá

Why risk data privacy with third-party APIs when you can run models natively? Discover how to deploy, quantize, and scale self-hosted LLMs for completely secure, offline development.

Starting at 24:52 · Watch from the beginning

Self-Hosted LLMs: From Zero to Inference thumbnail

Checking access…

Playback and chapters load privately for Free videos.

Matching moments

1:56 min

Running local open source models using Ollama

Aarno Aukia · LIVE

54 sec

Running generative AI models in local environments

Cedric Clyburn Cedric Clyburn · World Congress 2024

3:14 min

Building a community-governed LAMP stack for open AI

Raffi Krikorian Raffi Krikorian · World Congress 2026 Europe

1:24 min

Exploring open source inference tools for language model serving

Legare Kerrison Legare Kerrison +1 · World Congress 2026 North America

1:45 min

Introduction to serving large language models locally

Patrick Koss Patrick Koss · World Congress 2025

1:39 min

Addressing data privacy concerns with local language models

Upcoming sessions on this topic

Starts in 9 days

Conference India 2026

November 25–26, 2026

Bengaluru, India