World Congress 2025 • Aug 20, 2025 • Session details

distil labs – small model training, made simple

Selim Nowicki

Upgrading vanilla small models used to require specialized machine learning scientists and expensive infrastructure. Now, standard engineering teams can train highly accurate, on-premise expert models in just eight hours.

Pause
Mute Enter Fullscreen
#1 about 2 min

The case for deploying small foundational models

Small models provide critical advantages for local deployment, data privacy, and latency-sensitive applications.

#2 about 1 min

The challenge of specializing vanilla small models

Specializing out-of-the-box small models requires significant machine learning expertise and extensive labeled data.

#3 about 1 min

Automating expert model creation with minimal data

Automating the training process empowers developers to build highly accurate expert models using simple prompts.

#4 about 2 min

Applying synthetic data generation and knowledge distillation

Generating synthetic data with large language models automates the fine-tuning process through knowledge distillation.

Matching moments

1:24 min

Training small AI models on secure private data

Alexandre Guenoun Alexandre Guenoun +3 · World Congress 2026 Europe

2:12 min

Distilling cloud AI capabilities into local device models

3:48 min

Achieving high inference performance in smaller model sizes

Sam Witteveen · Coffee With Developers

6:16 min

The case for fine-tuning small models in agentic AI

Björn Buchhold Björn Buchhold · World Congress 2026 Europe

4:33 min

Reducing model size using knowledge distillation with teacher-student models

Marek Suppa · LIVE

1:10 min

Adopting fine-tuned task oriented AI models

Chris Heilmann +2 · LIVE

Upcoming sessions on this topic

Open session

World Congress 2026 North America

September 24, 2026 · 12:50–12:55

Outdoor Stage

Big brains on little machines with Supermodel Labs

Kirah Sapong, Daniel Dafoe

Kirah Sapong
Daniel Dafoe
Open session

World Congress 2026 North America

September 24, 2026 · 11:00–11:30

Stage 3

Making Science Larger, not just Faster

Yuval Dvir

Commercial Executive, SandboxAQ

Yuval Dvir
Open session

World Congress 2026 North America

September 24, 2026 · 14:10–14:40

Stage 5

Edge AI: Running Agentic Intelligence Where Internet Can't Reach

Nitin Eusebius

AWS - Principal Solutions Architect

Nitin Eusebius
Open session

World Congress 2026 North America

September 25, 2026 · 13:30–14:00

Stage 1

The State of Local AI in 2026

Kirah Sapong

Co-founder & CTO of Aquaduck AI

Kirah Sapong
Open session

World Congress 2026 North America

September 25, 2026 · 16:50–17:20

Stage 7

You Can’t Rerun Sunlight: Designing ML Data Architectures for Physical AI

An Phan

Senior Data Infrastructure Engineer @ Hippo Harvest

An Phan
Open session

World Congress 2026 North America

September 25, 2026 · 12:55–13:25

Stage 1

From Simulation to Reality: Overcoming the Data Challenge in Physical AI

Mitesh Patel

NVIDIA Corporation, Developer Advocate -- Manager

Mitesh Patel