World Congress 2024 • Aug 20, 2024 • Session details

Generative AI power on the web: making web apps smarter with WebGPU and WebNN

Christian Liebel

Why rely on costly cloud providers when you can run generative AI locally? Discover how WebGPU and WebNN unlock near-native, client-side machine learning performance directly in the browser.

Pause
Mute Enter Fullscreen
#1 about 5 min

Generative AI use cases for web applications

Generative AI enables image manipulation and unstructured data extraction directly within the browser.

#2 about 3 min

Challenges of cloud-based AI model providers

Cloud AI services present drawbacks including network dependency, latency, privacy risks, and subscription costs.

#3 about 7 min

Running large language models locally using WebLLM

Developers can execute downloaded large language models locally in the browser to process data offline.

#4 about 8 min

Accelerating in-browser AI with WebGPU and WebNN

Technologies like WebAssembly, WebGPU, and WebNN leverage system hardware to dramatically improve machine learning performance.

#5 about 8 min

Sharing models across origins with the Prompt API

Chrome's Prompt API mitigates large model downloads by sharing an integrated local model across web origins.

#6 about 2 min

Generating images locally with Stable Diffusion and WebSD

Web-based image generation is possible on commodity hardware using open-source models like Stable Diffusion.

#7 about 3 min

Evaluating trade-offs for local versus cloud AI models

While local models ensure privacy and offline availability, cloud models remain superior for high-performance tasks.

Matching moments

2:54 min

Leveraging Chrome AI and nano models for web applications

Raymond Camden · Perf + AI

2:17 min

Accelerating local machine learning models via WebNN

Christian Liebel Christian Liebel · World Congress 2026 Europe

1:04 min

Running local large language models securely using paired web GPUs

Önder Ceylan Önder Ceylan · World Congress 2024

2:46 min

The case for native AI in web browsers

Maxim Salnikov Maxim Salnikov · World Congress 2025

4:41 min

Exploring agentic browsers and artificial intelligence generation

Chris Heilmann Chris Heilmann +2 · LIVE

2:46 min

Enhancing native browser experiences with on-device generative AI

Chris Heilmann Chris Heilmann +2 · LIVE