WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
WeAreDevelopers LIVE • Jun 17, 2020

Raise your voice!

Lee Boonstra

Ditch rigid wake words and consumer timeouts by building your own custom voice AI. Master the full architecture using Angular, Node.js, and Dialogflow to handle complex, enterprise-grade conversations.

Pause
Mute Enter Fullscreen
#1 about 6 min

Developing custom voice AI versus ecosystem platforms

Custom voice solutions enable specialized hardware and independent deployments without consumer platform restrictions.

#2 about 4 min

Voice AI architecture and interactive kiosk demo

The application processes frontend WebRTC streams through Google APIs to drive an interactive multilingual kiosk.

#3 about 5 min

Capturing browser microphone access with RecordRTC

The RecordRTC library normalizes cross-browser media quirks and establishes predictable stream sample rates.

#4 about 2 min

Streaming bi-directional audio via Socket.io

Socket.io-stream establishes realtime bidirectional endpoints to pass binary audio from Angular to Node.js.

#5 about 4 min

Converting continuous audio streams to text

The Google Speech-to-Text API requires strictly matched audio encoding and sample rates to process streamed chunks.

#6 about 4 min

Classifying conversational intents using Dialogflow models

Dialogflow applies natural language understanding to detect complex conversational intents, map entity parameters, and trigger automated webhook fulfillments.

#7 about 5 min

Reconciling multilingual voice inputs with Translate API

The dynamic translation client converts arbitrary foreign input back to baseline English to ensure accurate intent matching.

#8 about 2 min

Synthesizing human-like voice responses with Wavenet

The Text-to-Speech API transforms textual responses into playback-ready linear16 audio buffers.

#9 about 2 min

Playing synthesized backend audio objects in browsers

The Angular frontend parses returned audio strings into HTML5 AudioContext nodes to circumvent restrictive mobile playback rules.

#10 about 2 min

Securing application microphone access with HTTPS deployments

App Engine Flex provides the automated SSL certificates required by modern browsers to allow microphone recording endpoints.

Matching moments

42 sec

Delivering dynamic voice interactions via ElevenLabs

Alexandra Mihai Alexandra Mihai +2 · Europe 2026 Virtual

2:11 min

Analyzing voice interface research projects and technical limitations

Tobias Münch Tobias Münch · World Congress 2024

1:05 min

Building a personal assistant interface using web speech

Tobias Münch Tobias Münch · World Congress 2024

1:44 min

Summarizing developer experience and artificial intelligence companions

Robert Hoffmann Robert Hoffmann +1 · LIVE

1:10 min

Architecting a web real-time communication stack for agents

Nathaniel Okenwa Nathaniel Okenwa · World Congress 2025

7:39 min

Streaming text responses from an AI language model

Chris Heilmann Chris Heilmann +2 · LIVE

More from WeAreDevelopers LIVE

WeAreDevelopers LIVE - Is CSS Catching Up to Flash? thumbnail
1:03:33
12 days ago

WeAreDevelopers LIVE - Is CSS Catching Up to Flash?

Chris Heilmann, Daniel Cranney, Bramus Van Damme

WeAreDevelopers LIVE - Project Chopin: Make Your Team and Agents Play Along thumbnail
1:21:17
19 days ago

WeAreDevelopers LIVE - Project Chopin: Make Your Team and Agents Play Along

Chris Heilmann, Daniel Cranney, Krzysztof Cieślak

Fake or News - AI Toothbrushes, Carrier Pigeon Tech & Life on Mars - Krzysztof Cieślak thumbnail
4:23
20 days ago

Fake or News - AI Toothbrushes, Carrier Pigeon Tech & Life on Mars - Krzysztof Cieślak

Chris Heilmann, Daniel Cranney

WeAreDevelopers LIVE - Open Source Agent Toolkits thumbnail
1:00:38
26 days ago

WeAreDevelopers LIVE - Open Source Agent Toolkits

Chris Heilmann, Daniel Cranney, Eddie Jaoude

Fake or News - AI Music Detectors, Translating Ancient Languages & Tiny Heads in Teslas - Eddie Jaoude thumbnail
6:16
27 days ago

Fake or News - AI Music Detectors, Translating Ancient Languages & Tiny Heads in Teslas - Eddie Jaoude

Chris Heilmann, Daniel Cranney

Fake or News: AI Agents Hire Each Other, Spider-Man Ads in Cars & RAM Thieves - Marc Plogas thumbnail
5:46
about 1 month ago

Fake or News: AI Agents Hire Each Other, Spider-Man Ads in Cars & RAM Thieves - Marc Plogas

Chris Heilmann, Daniel Cranney, Marc Plogas

Related videos

Performant Architecture for a Fast Gen AI User Experience thumbnail
25:47
World Congress 2024 • about 2 years ago

Performant Architecture for a Fast Gen AI User Experience

Nathaniel Okenwa

Hello JARVIS - Building Voice Interfaces for Your LLMS thumbnail
28:13
World Congress 2025 • about 1 year ago

Hello JARVIS - Building Voice Interfaces for Your LLMS

Nathaniel Okenwa

Is the web ready for voice user interfaces? thumbnail
23:09
World Congress 2024 • about 2 years ago

Is the web ready for voice user interfaces?

Tobias Münch

Speech-to-Speech AI models - Marius Obert thumbnail
9:43
Coffee With Developers • 3 months ago

Speech-to-Speech AI models - Marius Obert

Marius Obert

Speak, Code, Deploy: Transforming Developer Experience with Voice Commands thumbnail
28:37
World Congress 2024 • about 2 years ago

Speak, Code, Deploy: Transforming Developer Experience with Voice Commands

Sami Ekblad

Minimal infrastructure for Real‑Time Phone Agents: transcripts in, responses out thumbnail
29:35
LIVE • 12 months ago

Minimal infrastructure for Real‑Time Phone Agents: transcripts in, responses out

Chris Heilmann, Daniel Cranney, Marius Obert, Staff Evangelist At Twilio

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.