WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2026 Europe • Jul 10, 2026 • Session details

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend

David vonThenen

Did you know your microphone can read your typing? Discover how deep learning translates acoustic keystrokes into text, and learn to defend against these sophisticated side-channel attacks.

Pause
Mute Enter Fullscreen
#1 about 2 min

Understanding the concept of acoustic keystroke loggers

Translating individual typing sounds into recognized characters using specialized machine learning.

#2 about 2 min

Moral duality of artificial intelligence and machine learning

Comparing the societal benefits of algorithm research against the manipulative capabilities of advanced optimization.

#3 about 3 min

Translating audio signals into spectrographic images for classification

Converting raw sample recordings into distinct visual heatmaps that highlight unique frequency intensities.

#4 about 3 min

Processing audio datasets into training and testing splits

Preparing noiseless and multiple device audio collections to construct validation checkpoints.

#5 about 2 min

Demonstrating the audio to spectrographic image conversion pipeline

Executing python commands to generate visual rgb images from captured linear wave files.

#6 about 2 min

Training the classification model and running single keyboard inference

Loading a pre-trained safetensor pipeline to accurately pair acoustic fingerprints with their specific input characters.

#7 about 4 min

Running acoustic inference across a multiple keyboard dataset

Evaluating detection logic against independent laptop hardware models to measure confidence distribution falloff.

#8 about 7 min

Reconstructing full sentences with acoustic combinations and spellcheck

Using the distinctive resonance of the spacebar to isolate probability chains against dictionary APIs.

#9 about 2 min

Predicting missing words using specialized language models

Applying small language context engines to automatically hypothesize dropped characters inside imperfect transcriptions.

#10 about 3 min

Analyzing model accuracy limits and manufacturing hardware similarities

Understanding why high precision requires keyboards that physically align with factory production lots.

#11 about 2 min

Exploring practical applications of acoustic side channel attacks

Combining hidden microphone bugs with skimmer overlays to steal unencrypted pin code numbers.

#12 about 2 min

Implementing defensive countermeasures against acoustic side channel vulnerabilities

Preventing effective snooping by introducing intentional multi-channel noise streams and increasing overall password entropy.

#13 about 3 min

Providing educational resources for acoustic attack defense code

Reviewing open repository references so engineers can independently replicate and evaluate hardware vulnerabilities.

Matching moments

5:11 min

Exploiting systems through audio manipulation and prompt injections

Chris Heilmann Chris Heilmann +2 · LIVE

3:16 min

Unique privacy vulnerabilities in language model architectures

Aditi Godbole · LIVE

2:12 min

Open-source voice cloning and deepfake vulnerabilities

Chris Heilmann Chris Heilmann +3 · LIVE

1:15 min

Retaining the defender advantage in the cybersecurity race

Michele Zuccala Michele Zuccala +4 · World Congress 2026 Europe

6:36 min

Defensive strategies against AI-driven social engineering

Wolfgang Ettlinger +1 · World Congress 2023

58 sec

Manipulating AI models for privacy and anonymity

David vonThenen David vonThenen · World Congress 2025

More from World Congress 2026 Europe

Building the Nervous System of AI - Michael Kagan (NVIDIA) thumbnail
29:17
3 months ago

Building the Nervous System of AI - Michael Kagan (NVIDIA)

Michael Kagan, Sead Ahmetović

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote thumbnail
19:41
3 months ago

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote

Christian Heilmann

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes thumbnail
35:13
3 months ago

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes

Irina Branovic

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬 thumbnail
24:23
3 months ago

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬

Jeremy Murray

Angstfreude - AI and Corporate Culture - The Thrill and the Threat thumbnail
30:26
3 months ago

Angstfreude - AI and Corporate Culture - The Thrill and the Threat

Axel Ebert, Karin Krobath

Meta Harnesses: What the JS Framework Wars Teach Us About What Is Next for AI Agents thumbnail
30:30
3 months ago

Meta Harnesses: What the JS Framework Wars Teach Us About What Is Next for AI Agents

Victor Savkin

Related videos

Skynet wants your Passwords! The Role of AI in Automating Social Engineering thumbnail
31:19
World Congress 2023 • almost 3 years ago

Skynet wants your Passwords! The Role of AI in Automating Social Engineering

Wolfgang Ettlinger, Alexander Hurbean

Hacking AI - how attackers impose their will on AI thumbnail
27:02
World Congress 2023 • almost 3 years ago

Hacking AI - how attackers impose their will on AI

Mirko Ross

The AI Security Survival Guide: Practical Advice for Stressed-Out Developers thumbnail
30:36
World Congress 2024 • about 2 years ago

The AI Security Survival Guide: Practical Advice for Stressed-Out Developers

Mackenzie

Machine Learning: Promising, but Perilous thumbnail
27:19
World Congress 2023 • about 3 years ago

Machine Learning: Promising, but Perilous

Nura Kawa

A hundred ways to wreck your AI - the (in)security of machine learning systems thumbnail
24:23
World Congress 2023 • about 3 years ago

A hundred ways to wreck your AI - the (in)security of machine learning systems

Balázs Kiss

Confuse, Obfuscate, Disrupt: Using Adversarial Techniques for Better AI and True Anonymity thumbnail
27:34
World Congress 2025 • about 1 year ago

Confuse, Obfuscate, Disrupt: Using Adversarial Techniques for Better AI and True Anonymity

David vonThenen

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.