WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
WeAreDevelopers LIVE • Jun 17, 2020

Raise your voice!

Lee Boonstra

Ditch rigid wake words and consumer timeouts by building your own custom voice AI. Master the full architecture using Angular, Node.js, and Dialogflow to handle complex, enterprise-grade conversations.

Pause
Mute Enter Fullscreen
#1 about 6 min

Developing custom voice AI versus ecosystem platforms

Custom voice solutions enable specialized hardware and independent deployments without consumer platform restrictions.

#2 about 4 min

Voice AI architecture and interactive kiosk demo

The application processes frontend WebRTC streams through Google APIs to drive an interactive multilingual kiosk.

#3 about 5 min

Capturing browser microphone access with RecordRTC

The RecordRTC library normalizes cross-browser media quirks and establishes predictable stream sample rates.

#4 about 2 min

Streaming bi-directional audio via Socket.io

Socket.io-stream establishes realtime bidirectional endpoints to pass binary audio from Angular to Node.js.

#5 about 4 min

Converting continuous audio streams to text

The Google Speech-to-Text API requires strictly matched audio encoding and sample rates to process streamed chunks.

#6 about 4 min

Classifying conversational intents using Dialogflow models

Dialogflow applies natural language understanding to detect complex conversational intents, map entity parameters, and trigger automated webhook fulfillments.

#7 about 5 min

Reconciling multilingual voice inputs with Translate API

The dynamic translation client converts arbitrary foreign input back to baseline English to ensure accurate intent matching.

#8 about 2 min

Synthesizing human-like voice responses with Wavenet

The Text-to-Speech API transforms textual responses into playback-ready linear16 audio buffers.

#9 about 2 min

Playing synthesized backend audio objects in browsers

The Angular frontend parses returned audio strings into HTML5 AudioContext nodes to circumvent restrictive mobile playback rules.

#10 about 2 min

Securing application microphone access with HTTPS deployments

App Engine Flex provides the automated SSL certificates required by modern browsers to allow microphone recording endpoints.

Matching moments

2:11 min

Analyzing voice interface research projects and technical limitations

Tobias Münch Tobias Münch · WWC 2024

1:05 min

Building a personal assistant interface using web speech

Tobias Münch Tobias Münch · WWC 2024

1:44 min

Summarizing developer experience and artificial intelligence companions

Robert Hoffmann Robert Hoffmann +1 · LIVE

1:10 min

Architecting a web real-time communication stack for agents

Nathaniel Okenwa Nathaniel Okenwa · WWC 2025

7:39 min

Streaming text responses from an AI language model

Chris Heilmann +2 · LIVE

1:12 min

Enhancing conversational intent through modern large language models

Nathaniel Okenwa Nathaniel Okenwa · WWC 2025

More from WeAreDevelopers LIVE

Aliens in Quarantine, Python Deprecates Loops, and AI Buys Old Books - Zbyszek Tenerowicz thumbnail
5:43
5 days ago

Aliens in Quarantine, Python Deprecates Loops, and AI Buys Old Books - Zbyszek Tenerowicz

Chris Heilmann, Daniel Cranney

WeAreDevelopers LIVE - Node and Package Security thumbnail
1:08:30
5 days ago

WeAreDevelopers LIVE - Node and Package Security

Chris Heilmann, Daniel Cranney, Zbyszek Tenerowicz

WeAreDevelopers LIVE - Streaming HTML thumbnail
1:10:26
12 days ago

WeAreDevelopers LIVE - Streaming HTML

Chris Heilmann, Daniel Cranney, Jad Joubran

WeAreDevelopers LIVE - CODE100 at WeAreDevelopers Europe thumbnail
1:02:34
19 days ago

WeAreDevelopers LIVE - CODE100 at WeAreDevelopers Europe

Chris Heilmann, Daniel Cranney, Justin Halsall, Werner Jeschko, Nicole Jeschko, Mirco Tomić

WeAreDevelopers LIVE - Web Performance in an AI World thumbnail
1:07:59
26 days ago

WeAreDevelopers LIVE - Web Performance in an AI World

Chris Heilmann, Daniel Cranney

FIFA Hack, Midjourney Does Ultrasounds, and Trampoline Traffic Lights - Nicole Jeschko and Werner Jeschko thumbnail
5:55
about 2 months ago

FIFA Hack, Midjourney Does Ultrasounds, and Trampoline Traffic Lights - Nicole Jeschko and Werner Jeschko

Chris Heilmann, Daniel Cranney

Upcoming sessions on this topic

Open session

World Congress 2026 North America

From Software Agents to Physical Devices: Inside the Agentic Hardware Stack

Michael Yuan, Vivian Hu

Michael Yuan
Vivian Hu
Open session

World Congress 2026 North America

AI Agents are Only as Smart as their Context: Building a Real-Time Context Engine at Intuit

Bharat Patel

Lead Software Engineer at Intuit

Bharat Patel
Open session

World Congress 2026 North America

Small LLM in your Browser: Huge Opportunities for Web Applications

Daniel Ostrovsky

UI/UX Architect at Payoneer | AI Architect | Full Cycle Development Expert | Public Speaker | Open Source Contributor |

Daniel Ostrovsky
Open session

World Congress 2026 North America

Building Stuff with GenAI - The Open Minded Workshop beyond OpenAI

Andreas Erben

CTO for Applied AI and Metaverse at daenet

Andreas Erben
Open session

World Congress 2026 North America

Proactive AI That Doesn’t Annoy Users: Building Context-Aware Notification Systems

Raju Dandigam Dandigam

Engineering Manager at Navan

Raju Dandigam Dandigam
Open session

World Congress 2026 North America

When Agents Became Users: Rearchitecting Identity and Permissions for AI at Scale

Dor Cohen, Yoav Gal

Dor Cohen
Yoav Gal

Related videos

Performant Architecture for a Fast Gen AI User Experience thumbnail
25:47
WWC 2024 • almost 2 years ago

Performant Architecture for a Fast Gen AI User Experience

Nathaniel Okenwa

Hello JARVIS - Building Voice Interfaces for Your LLMS thumbnail
28:13
WWC 2025 • 12 months ago

Hello JARVIS - Building Voice Interfaces for Your LLMS

Nathaniel Okenwa

Is the web ready for voice user interfaces? thumbnail
23:09
WWC 2024 • almost 2 years ago

Is the web ready for voice user interfaces?

Tobias Münch

Speech-to-Speech AI models - Marius Obert thumbnail
9:43
Coffee With Developers • about 2 months ago

Speech-to-Speech AI models - Marius Obert

Marius Obert

Speak, Code, Deploy: Transforming Developer Experience with Voice Commands thumbnail
28:37
WWC 2024 • almost 2 years ago

Speak, Code, Deploy: Transforming Developer Experience with Voice Commands

Sami Ekblad

Minimal infrastructure for Real‑Time Phone Agents: transcripts in, responses out thumbnail
29:35
LIVE • 10 months ago

Minimal infrastructure for Real‑Time Phone Agents: transcripts in, responses out

Chris Heilmann, Daniel Cranney, Marius Obert, Staff Evangelist At Twilio

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.