Maxim Salnikov

Privacy-first in-browser Generative AI web apps: offline-ready, future-proof, standards-based

What if you could run powerful AI in a web app with total user privacy, completely offline? New browser APIs make it possible.

Privacy-first in-browser Generative AI web apps: offline-ready, future-proof, standards-based
#1about 3 minutes

A demo of client-side AI using the NPU

A computer vision application performs image classification directly in the browser without any backend calls by leveraging the device's Neural Processing Unit (NPU).

#2about 3 minutes

The case for privacy-first, on-device AI

On-device AI meets user demands for performance, privacy, and offline access while satisfying developer needs for a unified codebase and helpful abstractions.

#3about 3 minutes

Introducing the Web Neural Network (WebNN) standard

The emerging WebNN standard provides a model-agnostic, unified abstraction for near-native AI execution in the browser, designed around practical use cases.

#4about 4 minutes

Leveraging hardware like the CPU, GPU, and NPU

WebNN can access all available hardware, with the NPU offering a power-efficient alternative to the GPU for sustained AI workloads on mobile devices.

#5about 6 minutes

Getting started with the low-level WebNN API

To experiment with the emerging WebNN standard, developers must use canary browser versions and enable specific flags, but its low-level API can be complex.

#6about 7 minutes

Simplifying development with high-level AI frameworks

Frameworks like ONNX Runtime Web and Transformers.js provide higher-level, task-based abstractions over WebNN, making it easier for app developers to build AI features.

#7about 3 minutes

Best practices and the future of browser AI

Focus on user experience by providing fallbacks and progress indicators, and look ahead to upcoming built-in browser APIs like the Prompt API that abstract away model management.

#8about 2 minutes

Demo code and using web workers for performance

The demo applications are built as offline-ready Progressive Web Apps and use Web Workers to run intensive AI computations without freezing the main UI thread.

Related jobs
Jobs that call for the skills explored in this talk.

Matching moments

Performing inference in the browser with ONNX Runtime Web
33:35 MIN

Performing inference in the browser with ONNX Runtime Web

Making neural networks portable with ONNX

The future of on-device AI hardware and APIs
23:20 MIN

The future of on-device AI hardware and APIs

From ML to LLM: On-device AI in the Browser

Running on-device AI in the browser with Gemini Nano
31:13 MIN

Running on-device AI in the browser with Gemini Nano

Exploring Google Gemini and Generative AI

Implementing on-device AI with the Chrome AI API
33:57 MIN

Implementing on-device AI with the Chrome AI API

WeAreDevelopers LIVE – AI vs the Web & AI in Browsers

Standardizing web AI APIs across different browsers
09:04 MIN

Standardizing web AI APIs across different browsers

Exploring the Future of Web AI with Google

The technology behind in-browser AI execution
13:51 MIN

The technology behind in-browser AI execution

Generative AI power on the web: making web apps smarter with WebGPU and WebNN

Practical examples of using AI in daily life
01:32 MIN

Practical examples of using AI in daily life

Collaborative Intelligence: The Human & AI Partnership

Positioning generative AI as the next major technology shift
02:55 MIN

Positioning generative AI as the next major technology shift

The Data Phoenix: The future of the Internet and the Open Web

Featured Partners

Related Videos

See all videos
Generative AI power on the web: making web apps smarter with WebGPU and WebNN32:27

Generative AI power on the web: making web apps smarter with WebGPU and WebNN

Christian Liebel

Prompt API & WebNN: The AI Revolution Right in Your Browser30:36

Prompt API & WebNN: The AI Revolution Right in Your Browser

Christian Liebel

From ML to LLM: On-device AI in the Browser27:23

From ML to LLM: On-device AI in the Browser

Nico Martin

Exploring the Future of Web AI with Google33:51

Exploring the Future of Web AI with Google

Thomas Steiner

Performant Architecture for a Fast Gen AI User Experience25:47

Performant Architecture for a Fast Gen AI User Experience

Nathaniel Okenwa

Making neural networks portable with ONNX54:49

Making neural networks portable with ONNX

Ron Dagdag

AI: Superhero or Supervillain? How and Why with Scott Hanselman25:17

AI: Superhero or Supervillain? How and Why with Scott Hanselman

Scott Hanselman

WWC24 - Ankit Patel - Unlocking the Future Breakthrough Application Performance and Capabilities with NVIDIA22:07

WWC24 - Ankit Patel - Unlocking the Future Breakthrough Application Performance and Capabilities with NVIDIA

Ankit Patel

From learning to earning

Jobs that call for the skills explored in this talk.