WeAreDevelopers LIVE • Dec 16, 2024

Building a Browser-Based Karaoke Game with Web Speech API

Ana Rodrigues

Building "useless" side projects is the ultimate antidote to developer burnout. Watch Ana build a browser-based karaoke game to explore the Web Speech API and rediscover her frontend passion.

Pause
Mute Enter Fullscreen
#1 about 3 min

Motivation for building a gamified karaoke web app

The desire to create a browser-based karaoke game solving the lack of available songs for specific bands.

#2 about 2 min

Exploring the features of speech recognition and synthesis

How speech recognition and synthesis functionality can be utilized for continuous detection and forms input.

#3 about 3 min

Browser support and privacy concerns for speech recognition

Why features like native speech recognition often require a connected web server and lack consistent cross-browser support.

#4 about 5 min

Demonstrating voice navigation and synthesis bookmarklets

Live experiments showing how browser bookmarklets can turn text to speech or enable voice-activated page navigation.

#5 about 4 min

Implementing karaoke game logic and lyrics synchronization

The technical steps to initialize speech recognition, load timed lyric subtitles, and evaluate interim results.

#6 about 7 min

Testing the karaoke application with live singing

A live demonstration verifying text matching accuracy by comparing spoken word inputs against expected mapped lyrics.

#7 about 3 min

Current limitations of browser-based voice integrations

An overview of alternative polyfills, community projects, and the common voice dataset to improve voice technology reliance.

#8 about 2 min

Designing accessible voice content and interfaces

Actionable advice for structuring conversational content and handling error recovery in voice interaction designs.

#9 about 4 min

Combating burnout through unproductive side projects

Why experimenting with unmonetized ideas helps front-end developers learn new technical logic and rediscover creative programming joy.

Matching moments

2:30 min

Synthesizer karaoke and final presentation wrap up

Rowdy Rabouw Rowdy Rabouw · LIVE

1:30 min

Overview of voice user interfaces on the web

Tobias Münch Tobias Münch · World Congress 2024

48 sec

Core components of the web speech API ecosystem

Tobias Münch Tobias Münch · World Congress 2024

3:16 min

Voice AI architecture and interactive kiosk demo

Lee Boonstra · LIVE

4:24 min

Building synthesizers and music sequencers using web audio APIs

Chris Heilmann Chris Heilmann +2 · LIVE

58 sec

Uncensored voice assistants and neural controlled web browser accessibility

Chris Heilmann Chris Heilmann +2 · LIVE