WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2025 • Aug 20, 2025 • Session details

distil labs – small model training, made simple

Selim Nowicki

Upgrading vanilla small models used to require specialized machine learning scientists and expensive infrastructure. Now, standard engineering teams can train highly accurate, on-premise expert models in just eight hours.

Pause
Mute Enter Fullscreen
#1 about 2 min

The case for deploying small foundational models

Small models provide critical advantages for local deployment, data privacy, and latency-sensitive applications.

#2 about 1 min

The challenge of specializing vanilla small models

Specializing out-of-the-box small models requires significant machine learning expertise and extensive labeled data.

#3 about 1 min

Automating expert model creation with minimal data

Automating the training process empowers developers to build highly accurate expert models using simple prompts.

#4 about 2 min

Applying synthetic data generation and knowledge distillation

Generating synthetic data with large language models automates the fine-tuning process through knowledge distillation.

Matching moments

1:24 min

Training small AI models on secure private data

Alexandre Guenoun Alexandre Guenoun +3 · World Congress 2026 Europe

2:12 min

Distilling cloud AI capabilities into local device models

3:48 min

Achieving high inference performance in smaller model sizes

Sam Witteveen · Coffee With Developers

6:16 min

The case for fine-tuning small models in agentic AI

Björn Buchhold Björn Buchhold · World Congress 2026 Europe

4:33 min

Reducing model size using knowledge distillation with teacher-student models

Marek Suppa · LIVE

1:10 min

Adopting fine-tuned task oriented AI models

Chris Heilmann +2 · LIVE

More from World Congress 2025

GenAI Security: Navigating the Unseen Iceberg thumbnail
24:33
11 months ago

GenAI Security: Navigating the Unseen Iceberg

Maish Saidel-Keesing

Behind the Code: How Women Are Powering the Future of AI thumbnail
30:28
about 1 year ago

Behind the Code: How Women Are Powering the Future of AI

Alexandra Wudel, Laura Moritz, Madalina Florean

The AI Hype Filter: What’s Real, What’s Investable, What’s Noise? thumbnail
28:12
about 1 year ago

The AI Hype Filter: What’s Real, What’s Investable, What’s Noise?

Justus Lumpe, Konstantin Vinogradov, Nils Eiteneyer, Stephan Wirris

AI in Leadership: How Technology is Reshaping Executive Roles thumbnail
28:19
about 1 year ago

AI in Leadership: How Technology is Reshaping Executive Roles

Bernd Datler, Jasmin Kaiser, Jeff Hausmann, Sonja Alvarez

The AI-Ready Stack: Rethinking the Engineering Org of the Future thumbnail
28:09
about 1 year ago

The AI-Ready Stack: Rethinking the Engineering Org of the Future

Alex Laubscher, Jan Oberhauser, Keno Dreßel, Mirko Novakovic

AI Sovereignty: What Does It Take? thumbnail
29:13
about 1 year ago

AI Sovereignty: What Does It Take?

Boris Hecker, Clemens Wasner, Robin Hermann, Sonja Alvarez

Upcoming sessions on this topic

Open session

World Congress 2026 North America

September 24, 2026 · 11:00–11:30

Stage 3

Making Science Larger, not just Faster

Yuval Dvir

Commercial Executive, SandboxAQ

Yuval Dvir
Open session

World Congress 2026 North America

September 24, 2026 · 14:10–14:40

Stage 5

Edge AI: Running Agentic Intelligence Where Internet Can't Reach

Nitin Eusebius

AWS - Principal Solutions Architect

Nitin Eusebius
Open session

World Congress 2026 North America

September 25, 2026 · 13:30–14:00

Stage 1

The State of Local AI in 2026

Kirah Sapong

Co-founder & CTO of Aquaduck AI

Kirah Sapong
Open session

World Congress 2026 North America

September 25, 2026 · 11:40–12:10

Stage 9

You Can’t Re-Run Sunlight: Designing ML Data Architectures for Physical AI

An Phan

Senior Data Infrastructure Engineer @ Hippo Harvest

An Phan
Open session

World Congress 2026 North America

September 25, 2026 · 12:55–13:25

Stage 1

From Simulation to Reality: Overcoming the Data Scarcity Crisis in Physical AI

Mitesh Patel

NVIDIA Corporation, Developer Advocate -- Manager

Mitesh Patel
Open session

World Congress 2026 North America

September 25, 2026 · 09:00–09:30

Mainstage

Building AI that fits your business

Benny Chen

Co-Founder of Fireworks

Benny Chen

Related videos

Unlocking the Power of AI: Accessible Language Model Tuning for All thumbnail
31:50
World Congress 2024 • about 2 years ago

Unlocking the Power of AI: Accessible Language Model Tuning for All

Cedric Clyburn, @technicallylegare

Smaller Voice Models thumbnail
2:15
World Congress 2026 Europe • 2 months ago

Smaller Voice Models

Sohaib Ahmad

Fine-Tuning Small Language Models for Agentic AI thumbnail
29:18
World Congress 2026 Europe • 2 months ago

Fine-Tuning Small Language Models for Agentic AI

Björn Buchhold

AI That Fits Your Business, Not the Other Way Around thumbnail
25:56
World Congress 2026 Europe • 2 months ago

AI That Fits Your Business, Not the Other Way Around

Anshul Jindal, Cansu Kavili Örnek

How AI Models Get Smarter thumbnail
35:16
World Congress 2025 • about 1 year ago

How AI Models Get Smarter

Ankit Patel

Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source thumbnail
29:50
World Congress 2026 Europe • 2 months ago

Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source

Viktoria Semaan

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.