WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2024 • Aug 20, 2024 • Session details

Is the web ready for voice user interfaces?

Tobias Münch

Built-in browser speech APIs struggle with cloud privacy and complex state management. Can WebAssembly and local LLMs finally unlock offline, conversational web apps?

Pause
Mute Enter Fullscreen
#1 about 2 min

Overview of voice user interfaces on the web

Exploring existing W3C web speech standards and their potential application in modern web applications.

#2 about 2 min

Accessibility and practical use cases for voice interaction

Voice interfaces enable online participation for users with physical disabilities and streamline documentation for mobile workers.

#3 about 1 min

Core components of the web speech API ecosystem

The browser implementation divides voice functionality into distinct speech recognition and speech synthesis capabilities.

#4 about 3 min

Analyzing voice interface research projects and technical limitations

Experimental conversational web models highlight issues with recognition accuracy, latency, and required manual triggering mechanics.

#5 about 2 min

Building a personal assistant interface using web speech

Combining the standard web speech capability with large language models enables simple voice-driven chat applications.

#6 about 2 min

Configuring the browser speech recognition class and grammar

Instantiating the webkit speech recognition service requires specific parameter configurations and domain-specific grammar formatting.

#7 about 3 min

Extracting and mapping recognition results to application state

Handling multi-dimensional result arrays allows developers to extract text transcripts for dynamic interface updates.

#8 about 3 min

Privacy concerns and developer experience barriers to adoption

Low adoption rates stem from state management complexity alongside critical data privacy risks for sensitive workflows.

#9 about 3 min

Tracing the speech API architecture within the browser

The underlying Chromium implementation delegates voice data through multiple service layers before reaching an external processing engine.

#10 about 4 min

Decoupling state and voice commands with react genie

Semantic parsers map natural language inputs to backend application state to support complex offscreen operations hands-free.

#11 about 1 min

Quantifying developer experience with third-party software packages

Evaluating the hidden technical friction in external libraries helps inform better engineering tooling and methodology.

#12 about 2 min

The production readiness of current web voice interfaces

While experimental tools remain inconsistent for everyday tasks, emerging architectural concepts point toward a viable production future.

Matching moments

2:39 min

Current limitations of browser-based voice integrations

Ana Rodrigues · LIVE

58 sec

Uncensored voice assistants and neural controlled web browser accessibility

Chris Heilmann +2 · LIVE

2:37 min

Browser support and privacy concerns for speech recognition

Ana Rodrigues · LIVE

1:57 min

Architectural stack for speech-driven UI compilation

Sami Ekblad Sami Ekblad · WWC 2024

10:01 min

Why current voice recognition algorithms fail true accessibility standards

Chris Heilmann +2 · LIVE

4:50 min

Friction and utility of voice inputs for artificial intelligence

Chris Heilmann +2 · LIVE

More from World Congress 2024

Beyond the Hype: Real-World AI Strategies Panel thumbnail
24:07
10 months ago

Beyond the Hype: Real-World AI Strategies Panel

Mike Butcher, Jürgen Müller, Katrin Lehmann, Tobias Regenfuss

Carl Lapierre - Exploring Advanced Patterns in Retrieval-Augmented Generation thumbnail
21:17
almost 2 years ago

Carl Lapierre - Exploring Advanced Patterns in Retrieval-Augmented Generation

Carl Lapierre

Coding an Immersive Copilot using Unity / .NET and Azure OpenAI! thumbnail
31:50
almost 2 years ago

Coding an Immersive Copilot using Unity / .NET and Azure OpenAI!

Zaid Zaim

Building a diverse tech company: The power of Diversity, Equity, Inclusion, and Belonging thumbnail
29:43
almost 2 years ago

Building a diverse tech company: The power of Diversity, Equity, Inclusion, and Belonging

Sue Quackenbush

Dapr in Practice thumbnail
24:08
almost 2 years ago

Dapr in Practice

marcklefter

Minimising the Carbon Footprint of Workloads thumbnail
27:46
almost 2 years ago

Minimising the Carbon Footprint of Workloads

Michael Mueller

Upcoming sessions on this topic

Open session

World Congress 2026 North America

Small LLM in your Browser: Huge Opportunities for Web Applications

Daniel Ostrovsky

UI/UX Architect at Payoneer | AI Architect | Full Cycle Development Expert | Public Speaker | Open Source Contributor |

Daniel Ostrovsky
Open session

World Congress 2026 North America

From Software Agents to Physical Devices: Inside the Agentic Hardware Stack

Vivian Hu, Michael Yuan

Vivian Hu
Michael Yuan
Open session

World Congress 2026 North America

When Humans Stop Writing Code: Rethinking Languages, Compilers, and Responsibility

Simon Auer

Organizer of flutter vienna meetup and CEO of marqably

Simon Auer
Open session

World Congress 2026 North America

Vibe Coding Accessibility

Karl Groves

Focused on actively fixing accessibility

Karl Groves
Open session

World Congress 2026 North America

Building Stuff with GenAI - The Open Minded Workshop beyond OpenAI

Andreas Erben

CTO for Applied AI and Metaverse at daenet

Andreas Erben
Open session

World Congress 2026 North America

Building Pragmatic AI: 10 AI Features Your Users Actually Want

Jonathan "J." Tower

.NET Foundation Board | 12x Microsoft MVP | Founder & Consultant

Jonathan "J." Tower

Related videos

Speak, Code, Deploy: Transforming Developer Experience with Voice Commands thumbnail
28:37
WWC 2024 • almost 2 years ago

Speak, Code, Deploy: Transforming Developer Experience with Voice Commands

Sami Ekblad

Raise your voice! thumbnail
30:59
LIVE • about 6 years ago

Raise your voice!

Lee Boonstra

Hello JARVIS - Building Voice Interfaces for Your LLMS thumbnail
28:13
WWC 2025 • 12 months ago

Hello JARVIS - Building Voice Interfaces for Your LLMS

Nathaniel Okenwa

Exploring the Future of Web AI with Google thumbnail
33:51
Coffee With Developers • over 1 year ago

Exploring the Future of Web AI with Google

Thomas Steiner

WeAreDevelopers LIVE – AI and Privacy, On-Device AI and More thumbnail
1:00:55
LIVE • 7 months ago

WeAreDevelopers LIVE – AI and Privacy, On-Device AI and More

Chris Heilmann, Daniel Cranney, Tarek Ziadé

Performant Architecture for a Fast Gen AI User Experience thumbnail
25:47
WWC 2024 • almost 2 years ago

Performant Architecture for a Fast Gen AI User Experience

Nathaniel Okenwa

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.