WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2025 • Aug 20, 2025 • Session details

Privacy-first in-browser Generative AI web apps: offline-ready, future-proof, standards-based

Maxim Salnikov

Ditch costly cloud APIs and build fully private, offline-ready generative AI web apps. Run models locally using the WebNN API to ensure zero latency and absolute data privacy.

Pause
Mute Enter Fullscreen
#1 about 4 min

In-browser computer vision and NPU usage demo

Running a client-side image recognition task locally without backend APIs demonstrates basic offline capabilities.

#2 about 3 min

The case for native AI in web browsers

Performance constraints and privacy considerations drive the need to standardize local machine learning capabilities.

#3 about 3 min

Introducing the Web Neural Network API standard

The WebNN standard emerges as a hardware-agnostic layer to deliver near-native model execution.

#4 about 2 min

Overview of the Edge AI ecosystem and tech stack

Architectural layers connect underlying hardware silicon progressively up to high-level JavaScript application frameworks.

#5 about 5 min

Hardware acceleration with processors and neural units

Targeting different computing hardware optimizes throughput requirements and power efficiency limits for local operations.

#6 about 3 min

Setting up experimental browser flags and hardware drivers

Testing upcoming local machine learning features requires specific environment overrides and updated system drivers.

#7 about 2 min

Working with low-level WebNN execution graph logic

Constructing raw node execution arrays exposes deep complexity for frontend developers relying on specification bindings.

#8 about 3 min

Leveraging ONNX Runtime Web for local model execution

Higher-level runtime utilities simplify model loading syntax while directly routing calculations to web backends.

#9 about 4 min

Simplifying local AI tasks using the Transformers.js framework

Triggering specific multimodal tasks locally enables granular caching logic and seamless javascript dataset integrations.

#10 about 2 min

Best practices for user experience and large model caching

Building graceful local interactions relies on transparent download notifications and clear application state indicators.

#11 about 2 min

Using built-in browser Prompt APIs for language models

Offloading execution securely skips manual payload bundling entirely by hooking into a vendor's embedded assistant feature.

#12 about 2 min

Running AI applications with PWAs and background web workers

Web architectures isolate intense calculation models strictly to background processes to preserve responsiveness.

Matching moments

2:54 min

Leveraging Chrome AI and nano models for web applications

Raymond Camden · Perf + AI

2:17 min

Accelerating local machine learning models via WebNN

Christian Liebel Christian Liebel · World Congress 2026 Europe

4:41 min

Exploring agentic browsers and artificial intelligence generation

Chris Heilmann Chris Heilmann +2 · LIVE

2:46 min

Enhancing native browser experiences with on-device generative AI

Chris Heilmann Chris Heilmann +2 · LIVE

2:19 min

Drawbacks of cloud dependencies and local inference benefits

Christian Liebel Christian Liebel · World Congress 2025

53 sec

The shift toward client-side agentic web development

Jason Mayes · Coffee With Developers

More from World Congress 2025

GenAI Security: Navigating the Unseen Iceberg thumbnail
24:33
11 months ago

GenAI Security: Navigating the Unseen Iceberg

Maish Saidel-Keesing

Behind the Code: How Women Are Powering the Future of AI thumbnail
30:28
about 1 year ago

Behind the Code: How Women Are Powering the Future of AI

Alexandra Wudel, Laura Moritz, Madalina Florean

The AI Hype Filter: What’s Real, What’s Investable, What’s Noise? thumbnail
28:12
about 1 year ago

The AI Hype Filter: What’s Real, What’s Investable, What’s Noise?

Justus Lumpe, Konstantin Vinogradov, Nils Eiteneyer, Stephan Wirris

AI in Leadership: How Technology is Reshaping Executive Roles thumbnail
28:19
about 1 year ago

AI in Leadership: How Technology is Reshaping Executive Roles

Bernd Datler, Jasmin Kaiser, Jeff Hausmann, Sonja Alvarez

The AI-Ready Stack: Rethinking the Engineering Org of the Future thumbnail
28:09
about 1 year ago

The AI-Ready Stack: Rethinking the Engineering Org of the Future

Alex Laubscher, Jan Oberhauser, Keno Dreßel, Mirko Novakovic

AI Sovereignty: What Does It Take? thumbnail
29:13
about 1 year ago

AI Sovereignty: What Does It Take?

Boris Hecker, Clemens Wasner, Robin Hermann, Sonja Alvarez

Related videos

Prompt API & WebNN: The AI Revolution Right in Your Browser thumbnail
30:36
World Congress 2025 • about 1 year ago

Prompt API & WebNN: The AI Revolution Right in Your Browser

Christian Liebel

How Web AI Can Power the Agentic Web - Jason Mayes (Google) thumbnail
20:57
Coffee With Developers • 4 months ago

How Web AI Can Power the Agentic Web - Jason Mayes (Google)

Jason Mayes

Exploring the Future of Web AI with Google thumbnail
33:51
Coffee With Developers • over 1 year ago

Exploring the Future of Web AI with Google

Thomas Steiner

WeAreDevelopers LIVE – AI and Privacy, On-Device AI and More thumbnail
1:00:55
LIVE • 9 months ago

WeAreDevelopers LIVE – AI and Privacy, On-Device AI and More

Chris Heilmann, Daniel Cranney, Tarek Ziadé

Run AI models in the browser: Real life scenarios and implementations thumbnail
33:15
Europe 2026 Virtual • 3 months ago

Run AI models in the browser: Real life scenarios and implementations

Alexandru Hang

AI in the Open and in Browsers - Tarek Ziadé thumbnail
53:54
Coffee With Developers • 9 months ago

AI in the Open and in Browsers - Tarek Ziadé

Tarek Ziadé

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.