WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2024 • Aug 20, 2024 • Session details

Is the web ready for voice user interfaces?

Tobias Münch

Built-in browser speech APIs struggle with cloud privacy and complex state management. Can WebAssembly and local LLMs finally unlock offline, conversational web apps?

Pause
Mute Enter Fullscreen
#1 about 2 min

Overview of voice user interfaces on the web

Exploring existing W3C web speech standards and their potential application in modern web applications.

#2 about 2 min

Accessibility and practical use cases for voice interaction

Voice interfaces enable online participation for users with physical disabilities and streamline documentation for mobile workers.

#3 about 1 min

Core components of the web speech API ecosystem

The browser implementation divides voice functionality into distinct speech recognition and speech synthesis capabilities.

#4 about 3 min

Analyzing voice interface research projects and technical limitations

Experimental conversational web models highlight issues with recognition accuracy, latency, and required manual triggering mechanics.

#5 about 2 min

Building a personal assistant interface using web speech

Combining the standard web speech capability with large language models enables simple voice-driven chat applications.

#6 about 2 min

Configuring the browser speech recognition class and grammar

Instantiating the webkit speech recognition service requires specific parameter configurations and domain-specific grammar formatting.

#7 about 3 min

Extracting and mapping recognition results to application state

Handling multi-dimensional result arrays allows developers to extract text transcripts for dynamic interface updates.

#8 about 3 min

Privacy concerns and developer experience barriers to adoption

Low adoption rates stem from state management complexity alongside critical data privacy risks for sensitive workflows.

#9 about 3 min

Tracing the speech API architecture within the browser

The underlying Chromium implementation delegates voice data through multiple service layers before reaching an external processing engine.

#10 about 4 min

Decoupling state and voice commands with react genie

Semantic parsers map natural language inputs to backend application state to support complex offscreen operations hands-free.

#11 about 1 min

Quantifying developer experience with third-party software packages

Evaluating the hidden technical friction in external libraries helps inform better engineering tooling and methodology.

#12 about 2 min

The production readiness of current web voice interfaces

While experimental tools remain inconsistent for everyday tasks, emerging architectural concepts point toward a viable production future.

Matching moments

2:39 min

Current limitations of browser-based voice integrations

Ana Rodrigues · LIVE

58 sec

Uncensored voice assistants and neural controlled web browser accessibility

Chris Heilmann +2 · LIVE

2:37 min

Browser support and privacy concerns for speech recognition

Ana Rodrigues · LIVE

1:57 min

Architectural stack for speech-driven UI compilation

Sami Ekblad Sami Ekblad · World Congress 2024

10:01 min

Why current voice recognition algorithms fail true accessibility standards

Chris Heilmann +2 · LIVE

4:50 min

Friction and utility of voice inputs for artificial intelligence

Chris Heilmann +2 · LIVE

More from World Congress 2024

Beyond the Hype: Real-World AI Strategies Panel thumbnail
24:07
11 months ago

Beyond the Hype: Real-World AI Strategies Panel

Mike Butcher, Jürgen Müller, Katrin Lehmann, Tobias Regenfuss

Carl Lapierre - Exploring Advanced Patterns in Retrieval-Augmented Generation thumbnail
21:17
almost 2 years ago

Carl Lapierre - Exploring Advanced Patterns in Retrieval-Augmented Generation

Carl Lapierre

Coding an Immersive Copilot using Unity / .NET and Azure OpenAI! thumbnail
31:50
about 2 years ago

Coding an Immersive Copilot using Unity / .NET and Azure OpenAI!

Zaid Zaim

Building a diverse tech company: The power of Diversity, Equity, Inclusion, and Belonging thumbnail
29:43
about 2 years ago

Building a diverse tech company: The power of Diversity, Equity, Inclusion, and Belonging

Sue Quackenbush

Dapr in Practice thumbnail
24:08
about 2 years ago

Dapr in Practice

marcklefter

Minimising the Carbon Footprint of Workloads thumbnail
27:46
about 2 years ago

Minimising the Carbon Footprint of Workloads

Michael Mueller

Upcoming sessions on this topic

Open session

World Congress 2026 North America

September 25, 2026 · 15:30–16:00

Stage 6

Small LLM in your Browser: Huge Opportunities for Web Applications

Daniel Ostrovsky

UI/UX Architect at Payoneer | AI Architect | Full Cycle Development Expert | Public Speaker | Open Source Contributor |

Daniel Ostrovsky
Open session

World Congress 2026 North America

September 24, 2026 · 11:20–11:25

Outdoor Stage

Finding the Edges: Testing, Evaluating, and Monitoring Voice AI Agents Before Your Users Do

Matt Wyman

CEO of Okareo

Matt Wyman
Open session

World Congress 2026 North America

September 24, 2026 · 10:20–10:50

Stage 1

The Browser Is Becoming an AI Runtime

Ajit Varma, Will Bryk

Ajit Varma
Will Bryk
Open session

World Congress 2026 North America

September 24, 2026 · 16:10–16:40

Stage 5

From Software Agents to Physical Devices: Inside the Agentic Hardware Stack

Michael Yuan, Vivian Hu

Michael Yuan
Vivian Hu
Open session

World Congress 2026 North America

September 24, 2026 · 11:00–11:30

Stage 4

From Voice Demo to Enterprise Production

Anahita Havewala, Anuj Gupta

Anahita Havewala
Anuj Gupta
Open session

World Congress 2026 North America

September 24, 2026 · 16:10–16:40

Outdoor Stage

When Humans Stop Writing Code: Rethinking Languages, Compilers, and Responsibility

Simon Auer

Organizer of flutter vienna meetup and CEO of marqably

Simon Auer

Related videos

Speak, Code, Deploy: Transforming Developer Experience with Voice Commands thumbnail
28:37
World Congress 2024 • about 2 years ago

Speak, Code, Deploy: Transforming Developer Experience with Voice Commands

Sami Ekblad

Raise your voice! thumbnail
30:59
LIVE • about 6 years ago

Raise your voice!

Lee Boonstra

Hello JARVIS - Building Voice Interfaces for Your LLMS thumbnail
28:13
World Congress 2025 • about 1 year ago

Hello JARVIS - Building Voice Interfaces for Your LLMS

Nathaniel Okenwa

Exploring the Future of Web AI with Google thumbnail
33:51
Coffee With Developers • over 1 year ago

Exploring the Future of Web AI with Google

Thomas Steiner

WeAreDevelopers LIVE – AI and Privacy, On-Device AI and More thumbnail
1:00:55
LIVE • 8 months ago

WeAreDevelopers LIVE – AI and Privacy, On-Device AI and More

Chris Heilmann, Daniel Cranney, Tarek Ziadé

Performant Architecture for a Fast Gen AI User Experience thumbnail
25:47
World Congress 2024 • about 2 years ago

Performant Architecture for a Fast Gen AI User Experience

Nathaniel Okenwa

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.