WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2025 • Aug 20, 2025 • Session details

Privacy-first in-browser Generative AI web apps: offline-ready, future-proof, standards-based

Maxim Salnikov

Ditch costly cloud APIs and build fully private, offline-ready generative AI web apps. Run models locally using the WebNN API to ensure zero latency and absolute data privacy.

Pause
Mute Enter Fullscreen
#1 about 4 min

In-browser computer vision and NPU usage demo

Running a client-side image recognition task locally without backend APIs demonstrates basic offline capabilities.

#2 about 3 min

The case for native AI in web browsers

Performance constraints and privacy considerations drive the need to standardize local machine learning capabilities.

#3 about 3 min

Introducing the Web Neural Network API standard

The WebNN standard emerges as a hardware-agnostic layer to deliver near-native model execution.

#4 about 2 min

Overview of the Edge AI ecosystem and tech stack

Architectural layers connect underlying hardware silicon progressively up to high-level JavaScript application frameworks.

#5 about 5 min

Hardware acceleration with processors and neural units

Targeting different computing hardware optimizes throughput requirements and power efficiency limits for local operations.

#6 about 3 min

Setting up experimental browser flags and hardware drivers

Testing upcoming local machine learning features requires specific environment overrides and updated system drivers.

#7 about 2 min

Working with low-level WebNN execution graph logic

Constructing raw node execution arrays exposes deep complexity for frontend developers relying on specification bindings.

#8 about 3 min

Leveraging ONNX Runtime Web for local model execution

Higher-level runtime utilities simplify model loading syntax while directly routing calculations to web backends.

#9 about 4 min

Simplifying local AI tasks using the Transformers.js framework

Triggering specific multimodal tasks locally enables granular caching logic and seamless javascript dataset integrations.

#10 about 2 min

Best practices for user experience and large model caching

Building graceful local interactions relies on transparent download notifications and clear application state indicators.

#11 about 2 min

Using built-in browser Prompt APIs for language models

Offloading execution securely skips manual payload bundling entirely by hooking into a vendor's embedded assistant feature.

#12 about 2 min

Running AI applications with PWAs and background web workers

Web architectures isolate intense calculation models strictly to background processes to preserve responsiveness.

Matching moments

2:54 min

Leveraging Chrome AI and nano models for web applications

Raymond Camden · Perf + AI

7:17 min

Accelerating in-browser AI with WebGPU and WebNN

Christian Liebel Christian Liebel · World Congress 2024

2:17 min

Accelerating local machine learning models via WebNN

Christian Liebel Christian Liebel · World Congress 2026 Europe

3:58 min

Adopting local AI as a privacy-preserving progressive enhancement

Nico Martin · LIVE

4:41 min

Exploring agentic browsers and artificial intelligence generation

Chris Heilmann Chris Heilmann +2 · LIVE

2:46 min

Enhancing native browser experiences with on-device generative AI

Chris Heilmann Chris Heilmann +2 · LIVE

More from World Congress 2025

GenAI Security: Navigating the Unseen Iceberg thumbnail
24:33
12 months ago

GenAI Security: Navigating the Unseen Iceberg

Maish Saidel-Keesing

Behind the Code: How Women Are Powering the Future of AI thumbnail
30:28
about 1 year ago

Behind the Code: How Women Are Powering the Future of AI

Alexandra Wudel, Laura Moritz, Madalina Florean

The AI Hype Filter: What’s Real, What’s Investable, What’s Noise? thumbnail
28:12
about 1 year ago

The AI Hype Filter: What’s Real, What’s Investable, What’s Noise?

Justus Lumpe, Konstantin Vinogradov, Nils Eiteneyer, Stephan Wirris

AI in Leadership: How Technology is Reshaping Executive Roles thumbnail
28:19
about 1 year ago

AI in Leadership: How Technology is Reshaping Executive Roles

Bernd Datler, Jasmin Kaiser, Jeff Hausmann, Sonja Alvarez

The AI-Ready Stack: Rethinking the Engineering Org of the Future thumbnail
28:09
about 1 year ago

The AI-Ready Stack: Rethinking the Engineering Org of the Future

Alex Laubscher, Jan Oberhauser, Keno Dreßel, Mirko Novakovic

AI Sovereignty: What Does It Take? thumbnail
29:13
about 1 year ago

AI Sovereignty: What Does It Take?

Boris Hecker, Clemens Wasner, Robin Hermann, Sonja Alvarez

Upcoming sessions on this topic

Open session

Build a Zero-Cost AI Agent in Your Browser

  • Aishwarya Mathuria

    Adobe

    Computer Scientist

  • Nishant Thakur

    Adobe

    Senior Computer Scientist

Open session

React Under Fire: Rendering Performance for Streaming Agent UIs

  • Abhirupa Mitra

    Slack

    Senior Member of Technical Staff

Open session

From Prompt Engineering to Harness Engineering: Building Observable and Governed GenAI Systems

  • Lakshmi Devi Prakash

    JPMorgan Chase

    VP, Applied AI/ML Lead

Open session

Beware of Strangers Bearing Code: Open Source Trust in the Agent Era

  • Vikram Vaswani

    Consultant

Open session

Teaching AI Coding Agents to Build It Right the First Time

  • Sajeetharan Sinnathurai

    Microsoft

    Principal Product Manager

Open session

ULTRON: Your Agent Has No Hands - Real-Time Voice, MCP, and Ten Phones on Stage

  • Sagar Tamang

    Two Spoon Technologies

    AI Engineer

Related videos

Prompt API & WebNN: The AI Revolution Right in Your Browser thumbnail
30:36
World Congress 2025 • about 1 year ago

Prompt API & WebNN: The AI Revolution Right in Your Browser

Christian Liebel

Generative AI power on the web: making web apps smarter with WebGPU and WebNN thumbnail
32:27
World Congress 2024 • about 2 years ago

Generative AI power on the web: making web apps smarter with WebGPU and WebNN

Christian Liebel

How Web AI Can Power the Agentic Web - Jason Mayes (Google) thumbnail
20:57
Coffee With Developers • 5 months ago

How Web AI Can Power the Agentic Web - Jason Mayes (Google)

Jason Mayes

Exploring the Future of Web AI with Google thumbnail
33:51
Coffee With Developers • over 1 year ago

Exploring the Future of Web AI with Google

Thomas Steiner

From ML to LLM: On-device AI in the Browser thumbnail
27:23
LIVE • almost 2 years ago

From ML to LLM: On-device AI in the Browser

Nico Martin

WeAreDevelopers LIVE – AI and Privacy, On-Device AI and More thumbnail
1:00:55
LIVE • 9 months ago

WeAreDevelopers LIVE – AI and Privacy, On-Device AI and More

Chris Heilmann, Daniel Cranney, Tarek Ziadé

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.