WeAreDevelopers LIVE • Dec 16, 2024

From ML to LLM: On-device AI in the Browser

Nico Martin

Run large language models entirely in the browser without making a single cloud request. Discover how WebGPU, 4-bit quantization, and local RAG unlock fast, privacy-preserving AI applications.

Starting at 2:32 · Watch from the beginning

From ML to LLM: On-device AI in the Browser thumbnail

Checking access…

Playback and chapters load privately for Free videos.

Matching moments

7:17 min

Accelerating in-browser AI with WebGPU and WebNN

Christian Liebel

Christian Liebel · World Congress 2024

2:46 min

The case for native AI in web browsers

Maxim Salnikov

Maxim Salnikov · World Congress 2025

1:04 min

Running local large language models securely using paired web GPUs

Önder Ceylan

Önder Ceylan · World Congress 2024

1:52 min

Industry alignment on running language models in browsers

Daniel Ostrovsky

Daniel Ostrovsky · World Congress 2026 North America

2:17 min

Accelerating local machine learning models via WebNN

Christian Liebel

Christian Liebel · World Congress 2026 Europe

2:54 min

Leveraging Chrome AI and nano models for web applications

Raymond Camden · Perf + AI

More from WeAreDevelopers LIVE

Why Your Side Projects Are Worth Sharing thumbnail

Why Your Side Projects Are Worth Sharing

Haimantika Mitra +2

Yesterday

Humans in the Loop: Storytelling in Tech thumbnail

Humans in the Loop: Storytelling in Tech

Pritesh Kiri +2

Last week

WeAreDevelopers LIVE: Your Brain Is Lying to You: Cognitive Biases in Development thumbnail

Your Brain Is Lying to You: Cognitive Biases in Development

2 weeks ago

Like Peas in a Pod - What Happens When People Clone Your App? thumbnail

Like Peas in a Pod - What Happens When People Clone Your App?

Ivan Kutskir +2

3 weeks ago

WeAreDevelopers LIVE - Read more, Prompt Less thumbnail

Read more, Prompt Less

Luise Freese +2

4 weeks ago

WeAreDevelopers LIVE - Tech Education in Two Languages thumbnail

Tech Education in Two Languages

Roxy Rodriguez-Becker +1

Oct 2026

Upcoming sessions on this topic

Starts in 13 days

Conference India 2026

November 25–26, 2026

Bengaluru, India

Get tickets All 107 sessions

Built-In AI in the Browser: Practical Capabilities for Modern Web Apps
Piyush Gupta · Expedia

Thu 26 Nov · Stage 4
Build a Zero-Cost AI Agent in Your Browser
Aishwarya Mathuria & Nishant Thakur

Thu 26 Nov · Room 8
Bypassing the GPU Tax: Smart Layer-7 Routing with Small Language Models (SLMs)
Sagar Utekar · CrowdStrike

Thu 26 Nov · Stage 2

Related videos

Generative AI power on the web: making web apps smarter with WebGPU and WebNN thumbnail

Generative AI power on the web: making web apps smarter with WebGPU and WebNN

Christian Liebel · Thinktecture

World Congress · 2024

Exploring the Future of Web AI with Google thumbnail

Exploring the Future of Web AI with Google

Thomas Steiner

Coffee With Developers · Feb 2025

Prompt API & WebNN: The AI Revolution Right in Your Browser thumbnail

Prompt API & WebNN: The AI Revolution Right in Your Browser

Christian Liebel · Thinktecture

World Congress · 2025

AI in Your Browser: Exploring Chrome's Built-In LLM thumbnail

AI in Your Browser: Exploring Chrome's Built-In LLM

Daniel Ostrovsky · Payoneer

World Congress Europe · 2026

Small LLM in your Browser: Huge Opportunities for Web Applications thumbnail

Small LLM in your Browser: Huge Opportunities for Web Applications

Daniel Ostrovsky · Payoneer

World Congress North America · 2026

How Web AI Can Power the Agentic Web - Jason Mayes (Google) thumbnail

How Web AI Can Power the Agentic Web - Jason Mayes (Google)

Jason Mayes

Coffee With Developers · May 2026

Related articles

LM

Luis Minvielle

What Are Large Language Models?

Developers and writers can finally agree on one thing: Large Language Models, the subset of AIs that drive ChatGPT and its competitors, are stunning tech creations. Developers enjoying the likes of...

about 3 years ago

What Are Large Language Models?

CH

Chris Heilmann

Dev Digest 138 - Are you secure about this?

Hello there! This is the 2nd "out of the can" edition of 3 as I am on vacation in Greece eating lovely things on the beach. So, fewer news, but lots of great resources. Many around the topic of sec...

about 2 years ago

Dev Digest 138 - Are you secure about this?

BB

Benedikt Bischof

MLOps And AI Driven Development

Welcome to this issue of the WeAreDevelopers Dev Talk Recap series. This article recaps an interesting talk by Natalie Pistunovic who spoke about the development of AI and MLOps. What you will lear...

over 4 years ago

MLOps And AI Driven Development

CH

Chris Heilmann

AI overspill Dec 2026: AI in a JAM, Blocking AI browsers, learning programming languages

Welcome to the AI overspill for December 2025. Here are some of the links that didn’t make it to the WeAreDevelopers Dev Digest but are still interesting to check out. Jonah Glover of Hightouch tr...

11 months ago

a confused robot looking at the space jam web site

From learning to earning

Jobs that call for the skills explored in this talk.

about 2 months ago •

AI Software Engineer (Germany)

Berlin, Germany

Expert €70k–100k Remote REST TypeScript AI Frameworks

about 1 month ago

Machine Learning Engineer

Valencia, Spain

Remote Twilio AutoGen Pytorch

Senior Engineer, Google Cloud

Grand Rapids, MI, United States

Expert $77k–202k LangChain Google Cloud Spring Cloud

Senior Engineer, Google Cloud

Atlanta, GA, United States

Expert $77k–202k LangChain Google Cloud Spring Cloud

Senior Engineer, Google Cloud

Birmingham, AL, United States

Expert $77k–202k LangChain Google Cloud Spring Cloud

Senior Engineer, Google Cloud

Phoenix, AZ, United States

Expert $77k–202k LangChain Google Cloud Spring Cloud