World Congress 2024 • Aug 22, 2024 • Session details

Speak, Code, Deploy: Transforming Developer Experience with Voice Commands

Sami Ekblad

Dramatically accelerate your frontend code-compile-deploy loop without touching a keyboard. Discover how combining GPT-4 with voice APIs turns spoken instructions into functional UI components instantly.

Pause
Mute Enter Fullscreen
#1 about 1 min

Discovering accessibility features as everyday utility tools

Accessibility settings on mobile devices offer alternative navigation methods that benefit all users.

#2 about 2 min

Abstracting web UI complexity with Vaadin Java components

Encapsulating complex frontend details inside dynamic runtime Java APIs reduces developer friction.

#3 about 3 min

Measuring developer experience through friction points

Surveys reveal that compile times, changing requirements, and context switches are top developer complaints.

#4 about 3 min

Optimizing the code, compile, deploy, and test cycle

Fast development loops deliver measurable productivity and ensure better mental connections with interface modifications.

#5 about 2 min

Bringing instant UI feedback to Java applications

Mimicking the engaging feedback loops of JavaScript happens through dynamic Java components and visual editors.

#6 about 2 min

Leveraging large language models for voice coding context

Modern natural language capabilities enable contextual chat-driven development and experimental code generation.

#7 about 2 min

Architectural stack for speech-driven UI compilation

Combining wake word detection, the Web Speech API, GPT-4, and Java enables rapid voice-to-interface compile cycles.

#8 about 4 min

Creating and styling basic UI components by voice

Voice commands lower the mental cost of experimenting with functional listeners, contrast logic, and dynamic colors.

#9 about 3 min

Controlling layout context and interaction through voice prompts

Context-aware models easily assemble familiar layouts like standard webpages and search interfaces from simple speech.

#10 about 3 min

Generating functional interface forms with runtime validations

Instructing artificial intelligence to construct form fields alongside validation logic pushes voice development into functional use cases.

#11 about 3 min

Mitigating context drift and speed constraints in language models

Reusing precompiled components and manually resetting conversational context helps manage continuous generation drift.

#12 about 3 min

Reframing accessibility tech and misusing development tools

Treating accessibility as a fundamental feature and purposely misusing technology unlocks innovative developer workflows.

#13 about 3 min

Discussing open source availability and accessibility adaptiveness

A question session covers open source repository licenses, voice interaction speed comparisons, and applications for developers with dyslexia.

Matching moments

3:01 min

Voice recognition integration for application code generation

1:30 min

Overview of voice user interfaces on the web

Tobias Münch Tobias Münch · World Congress 2024

1:29 min

Designing accessible voice content and interfaces

Ana Rodrigues · LIVE

1:49 min

Accessibility and practical use cases for voice interaction

Tobias Münch Tobias Münch · World Congress 2024

1:44 min

Summarizing developer experience and artificial intelligence companions

Robert Hoffmann Robert Hoffmann +1 · LIVE

3:13 min

Rethinking developer environments with conversational code assistance

Sam Witteveen · Coffee With Developers