World Congress 2025 Aug 20, 2025 Session details

distil labs – small model training, made simple

Selim Nowicki

Upgrading vanilla small models used to require specialized machine learning scientists and expensive infrastructure. Now, standard engineering teams can train highly accurate, on-premise expert models in just eight hours.

Pause
Mute Enter Fullscreen
#1 about 2 min

The case for deploying small foundational models

Small models provide critical advantages for local deployment, data privacy, and latency-sensitive applications.

#2 about 1 min

The challenge of specializing vanilla small models

Specializing out-of-the-box small models requires significant machine learning expertise and extensive labeled data.

#3 about 1 min

Automating expert model creation with minimal data

Automating the training process empowers developers to build highly accurate expert models using simple prompts.

#4 about 2 min

Applying synthetic data generation and knowledge distillation

Generating synthetic data with large language models automates the fine-tuning process through knowledge distillation.

Matching moments

1:24 min

Training small AI models on secure private data

Alexandre Guenoun Alexandre Guenoun +3 · WWC Europe 2026

2:12 min

Distilling cloud AI capabilities into local device models

3:48 min

Achieving high inference performance in smaller model sizes

Sam Witteveen · Coffee With Developers

6:16 min

The case for fine-tuning small models in agentic AI

Björn Buchhold Björn Buchhold · WWC Europe 2026

4:33 min

Reducing model size using knowledge distillation with teacher-student models

Marek Suppa · LIVE

1:10 min

Adopting fine-tuned task oriented AI models

Chris Heilmann +2 · LIVE

Upcoming sessions on this topic

Open session

World Congress 2026 North America

Making Science Larger, not just Faster

Yuval Dvir

Commercial Executive, SandboxAQ

Yuval Dvir
Open session

World Congress 2026 North America

You Can’t Re-Run Sunlight: Designing ML Data Architectures for Physical AI

An Phan

Senior Data Infrastructure Engineer @ Hippo Harvest

An Phan
Open session

World Congress 2026 North America

Fast, Cheap, and Accurate: Optimizing LLM Inference with vLLM and Quantization

Cedric Clyburn, Legare Kerrison

Cedric Clyburn
Legare Kerrison
Open session

World Congress 2026 North America

Building Stuff with GenAI - The Open Minded Workshop beyond OpenAI

Andreas Erben

CTO for Applied AI and Metaverse at daenet

Andreas Erben
Open session

World Congress 2026 North America

No Single Model to Rule Them All: Building Resilient AI Agents Across Open & Closed LLMs

Emmanuel Acheampong

Senior Manager Developer Relations at Crusoe AI

Emmanuel Acheampong
Open session

World Congress 2026 North America

Building Pragmatic AI: 10 AI Features Your Users Actually Want

Jonathan "J." Tower

.NET Foundation Board | 12x Microsoft MVP | Founder & Consultant

Jonathan "J." Tower