Selim Nowicki

distil labs – small model training, made simple

Create expert AI models without ML expertise. Turn 50 data points into a specialized model that's 100x smaller than a large one.

distil labs – small model training, made simple
#1about 1 minute

The benefits and use cases for small models

Small models offer advantages in local deployment for privacy, on-device processing, and efficiency gains like lower cost and latency.

#2about 1 minute

Why specializing small models is difficult

Out-of-the-box small models underperform, and specializing them into expert models requires ML skills and thousands of labeled data points.

#3about 2 minutes

How Distill Labs automates expert model creation

The platform reduces data and skill requirements by using a prompt and 50 data points to generate synthetic data for automated fine-tuning.

#4about 1 minute

Using knowledge distillation to empower developers

The platform leverages a technique called knowledge distillation, enabling developers to build high-quality models without a dedicated machine learning team.

Related jobs
Jobs that call for the skills explored in this talk.

Matching moments

The benefits and challenges of running AI models locally
05:39 MIN

The benefits and challenges of running AI models locally

WeAreDevelopers LIVE - Is AI replacing developers?, Stopping bots, AI on device & more

How AI models are becoming smaller and more efficient
02:53 MIN

How AI models are becoming smaller and more efficient

Google Gemini: Open Source and Deep Thinking Models - Sam Witteveen

The rise of local models and agentic systems
04:42 MIN

The rise of local models and agentic systems

Graphs and RAGs Everywhere... But What Are They? - Andreas Kollegger - Neo4j

Managing the rapid pace of AI development and its impact
06:46 MIN

Managing the rapid pace of AI development and its impact

From Monolith Tinkering to Modern Software Development

Training small, specialized language models from scratch
01:31 MIN

Training small, specialized language models from scratch

Beyond Autocomplete: Local AI Code Completion Demystified

Why specialized models outperform generalist LLMs
05:09 MIN

Why specialized models outperform generalist LLMs

AI in the Open and in Browsers - Tarek Ziadé

Introducing InstructLab for accessible LLM fine-tuning
01:12 MIN

Introducing InstructLab for accessible LLM fine-tuning

Unlocking the Power of AI: Accessible Language Model Tuning for All

Using large language models as a learning tool
03:42 MIN

Using large language models as a learning tool

Google Gemini: Open Source and Deep Thinking Models - Sam Witteveen

Featured Partners

Related Videos

See all videos
How AI Models Get Smarter
35:16

How AI Models Get Smarter

Ankit Patel

Self-Hosted LLMs: From Zero to Inference
30:04

Self-Hosted LLMs: From Zero to Inference

Roberto Carratalá & Cedric Clyburn

Unlocking the Power of AI: Accessible Language Model Tuning for All
31:50

Unlocking the Power of AI: Accessible Language Model Tuning for All

Cedric Clyburn & Legare Kerrison

Unveiling the Magic: Scaling Large Language Models to Serve Millions
31:25

Unveiling the Magic: Scaling Large Language Models to Serve Millions

Patrick Koss

Adding knowledge to open-source LLMs
25:35

Adding knowledge to open-source LLMs

Sergio Perez & Harshita Seth

Secure and Private AI - DeepMask
04:57

Secure and Private AI - DeepMask

Hissan Usmani

Serverless deployment of (large) NLP models
39:02

Serverless deployment of (large) NLP models

Marek Suppa

Inside the Mind of an LLM
27:11

Inside the Mind of an LLM

Emanuele Fabbiani

Related Articles

View all articles
Luis Minvielle
What Are Large Language Models?
Developers and writers can finally agree on one thing: Large Language Models, the subset of AIs that drive ChatGPT and its competitors, are stunning tech creations. Developers enjoying the likes of GitHub Copilot know the feeling: this new kind of te...
What Are Large Language Models?
Krissy Davis
The Best Large Language Models on The Market
Large language models are sophisticated programs that enable machines to comprehend and generate human-like text. They have been the foundation of natural language processing for almost a decade. Although generative AI has only recently gained popula...
The Best Large Language Models on The Market

From learning to earning

Jobs that call for the skills explored in this talk.