> Markdown version of [/videos/1283-from-ml-to-llm-on-device-ai-in-the-browser?t=152](https://www.wearedevelopers.com/videos/1283-from-ml-to-llm-on-device-ai-in-the-browser?t=152). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# From ML to LLM: On-device AI in the Browser

Run large language models entirely in the browser without making a single cloud request. Discover how WebGPU, 4-bit quantization, and local RAG unlock fast, privacy-preserving AI applications.

- **Speakers:** Nico Martin
- **Event:** WeAreDevelopers LIVE
- **Published:** December 16, 2024
- **Duration:** 27:23
- **URL:** https://www.wearedevelopers.com/videos/1283-from-ml-to-llm-on-device-ai-in-the-browser
- **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/79a651c245161d7bd37808dcb0ce1797/thumbnails/thumbnail.jpg?time=30000ms

## Access

Playback and chapters for this video are available with a Free account.

## Related Moments

- [Accelerating in-browser AI with WebGPU and WebNN](https://www.wearedevelopers.com/videos/953-generative-ai-power-on-the-web-making-web-apps-smarter-with-webgpu-and-webnn) (from "Generative AI power on the web: making web apps smarter with WebGPU and WebNN")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/6f70411cbb9bbdc80884bec37bdb61ac/thumbnails/thumbnail.jpg?time=30000ms
- [The case for native AI in web browsers](https://www.wearedevelopers.com/videos/1572-privacy-first-in-browser-generative-ai-web-apps-offline-ready-future-proof-standards-based) (from "Privacy-first in-browser Generative AI web apps: offline-ready, future-proof, standards-based")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/82e4a2a645c55cdfe17adf7d83d91023/thumbnails/thumbnail.jpg?time=188755ms
- [Running local large language models securely using paired web GPUs](https://www.wearedevelopers.com/videos/1149-webassembly-revolution-elevating-javascript-s-reach-and-performance) (from "WebAssembly Revolution: Elevating JavaScript's Reach and Performance")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/52d2e6ed22eb82fb1df5404c722ea009/thumbnails/thumbnail.jpg?time=148585ms
- [Industry alignment on running language models in browsers](https://www.wearedevelopers.com/videos/100402-small-llm-in-your-browser-huge-opportunities-for-web-applications) (from "Small LLM in your Browser: Huge Opportunities for Web Applications")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/7aaf6b0e82aca62a0f103e49ac678066/thumbnails/thumbnail.jpg?time=206878ms
- [Accelerating local machine learning models via WebNN](https://www.wearedevelopers.com/videos/100014-what-s-new-in-web-2026-edition) (from "What’s New in Web? 2026 Edition")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/26b2bce16638ff64b517c7d7ca219144/thumbnails/thumbnail.jpg?time=93080ms
- [Leveraging Chrome AI and nano models for web applications](https://www.wearedevelopers.com/videos/1770-generate-ai-in-the-browser-with-chrome-ai-raymond-camden) (from "Generate AI in the Browser with Chrome AI - Raymond Camden")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/b4d5e9957facb73c70ab0ca7dfec3b97/thumbnails/thumbnail.jpg?time=190945ms

## Related Articles

- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [Dev Digest 138 - Are you secure about this?](https://www.wearedevelopers.com/magazine/486-dev-digest-138-are-you-secure-about-this)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [AI overspill Dec 2026: AI in a JAM, Blocking AI browsers, learning programming languages ](https://www.wearedevelopers.com/magazine/673-ai-overspill-dec-2026-ai-in-a-jam-blocking-ai-browsers-learning-programming-languages)

## Related Jobs

- [AI Software Engineer (Germany)](https://www.wearedevelopers.com/jobs/48317-ai-software-engineer-germany) at **Sunhat**
- [Machine Learning Engineer](https://www.wearedevelopers.com/jobs/ext/4215706-machine-learning-engineer) at **TWILIO**
- [Senior Engineer, Google Cloud](https://www.wearedevelopers.com/jobs/ext/4567686-senior-engineer-google-cloud) at **PwC**
- [Senior Engineer, Google Cloud](https://www.wearedevelopers.com/jobs/ext/4571451-senior-engineer-google-cloud) at **PwC**
- [Senior Engineer, Google Cloud](https://www.wearedevelopers.com/jobs/ext/4570186-senior-engineer-google-cloud) at **PwC**
- [Senior Engineer, Google Cloud](https://www.wearedevelopers.com/jobs/ext/4566395-senior-engineer-google-cloud) at **PwC**