WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2025 • Aug 20, 2025 • Session details

Inside the Mind of an LLM

Emanuele Fabbiani

Why do language models route translations through English? Learn how sparse autoencoders allow developers to mathematically suppress biases and deterministically control AI behavior.

Pause
Mute Enter Fullscreen
#1 about 3 min

Taking a leap of faith with large language models

Treating model interfaces like car controls obscures the underlying complexity and potential system failures.

#2 about 2 min

Spotting obvious factual errors in model outputs

Simple factual errors produced by language models are relatively easy for users to identify and discard.

#3 about 4 min

Replicating bad code distributions with generative models

Models trained on broad repositories often reproduce vulnerabilities and bugs from their training data.

#4 about 3 min

Pre-training language models to understand human text

Masking words in massive datasets teaches language models basic understanding and reliable text completion.

#5 about 1 min

Fine-tuning models to answer questions and execute tasks

Supervised learning on prompt and answer pairs transforms a text completion engine into a responsive assistant.

#6 about 4 min

Aligning models using reinforcement learning with human feedback

Training a reward proxy based on human preferences ensures outputs align with safety and societal expectations.

#7 about 2 min

Autoregressive token completion without internal reasoning

Large language models generate responses strictly by predicting the most likely next token without logical thought.

#8 about 6 min

Discovering English as an internal intermediate representation

Analyzing layer activations reveals that multilingual translation tasks often route through an English representation.

#9 about 5 min

Controlling model behavior through monosemantic feature extraction

Mapping internal activations to singular semantic concepts allows deterministic manipulation of specific model outputs.

#10 about 2 min

Memorization of private training data in deep learning

The mathematical necessity of reducing loss forces models to memorize unique personal information from training sets.

Matching moments

2:37 min

Understanding core parameters and mechanics of large language models

Julián Duque Julián Duque · World Congress 2025

5:25 min

Addressing core challenges in large language model deployments

Vijay Krishan Gupta +1 · LIVE

5:01 min

Leveraging large language models for code optimization and development

Stephan Gillich Stephan Gillich +3 · World Congress 2024

4:25 min

Overcoming AI hallucinations and restrictive content guardrails

Perf + AI

2:20 min

Distinguishing large language models from autonomous AI agents

Coffee With Developers

2:25 min

Understanding the evolution and nature of large language models

Krzysztof Cieślak Krzysztof Cieślak · World Congress 2024

More from World Congress 2025

GenAI Security: Navigating the Unseen Iceberg thumbnail
24:33
11 months ago

GenAI Security: Navigating the Unseen Iceberg

Maish Saidel-Keesing

Behind the Code: How Women Are Powering the Future of AI thumbnail
30:28
about 1 year ago

Behind the Code: How Women Are Powering the Future of AI

Alexandra Wudel, Laura Moritz, Madalina Florean

The AI Hype Filter: What’s Real, What’s Investable, What’s Noise? thumbnail
28:12
about 1 year ago

The AI Hype Filter: What’s Real, What’s Investable, What’s Noise?

Justus Lumpe, Konstantin Vinogradov, Nils Eiteneyer, Stephan Wirris

AI in Leadership: How Technology is Reshaping Executive Roles thumbnail
28:19
about 1 year ago

AI in Leadership: How Technology is Reshaping Executive Roles

Bernd Datler, Jasmin Kaiser, Jeff Hausmann, Sonja Alvarez

The AI-Ready Stack: Rethinking the Engineering Org of the Future thumbnail
28:09
about 1 year ago

The AI-Ready Stack: Rethinking the Engineering Org of the Future

Alex Laubscher, Jan Oberhauser, Keno Dreßel, Mirko Novakovic

AI Sovereignty: What Does It Take? thumbnail
29:13
about 1 year ago

AI Sovereignty: What Does It Take?

Boris Hecker, Clemens Wasner, Robin Hermann, Sonja Alvarez

Related videos

Lies, Damned Lies and Large Language Models thumbnail
29:40
LIVE • almost 2 years ago

Lies, Damned Lies and Large Language Models

Jodie Burchell

Adding knowledge to open-source LLMs thumbnail
25:35
World Congress 2025 • about 1 year ago

Adding knowledge to open-source LLMs

Harshita Seth, Sergio Perez

Three years of putting LLMs into Software - Lessons learned thumbnail
26:30
World Congress 2025 • about 1 year ago

Three years of putting LLMs into Software - Lessons learned

Simon A.T. Jiménez

Creating Industry ready solutions with LLM Models thumbnail
58:00
LIVE • over 2 years ago

Creating Industry ready solutions with LLM Models

Vijay Krishan Gupta, Gauravdeep Singh Lotey

You are not my model anymore - understanding LLM model behavior thumbnail
24:11
World Congress 2025 • about 1 year ago

You are not my model anymore - understanding LLM model behavior

Andreas Erben

How to Avoid LLM Pitfalls - Mete Atamel and Guillaume Laforge thumbnail
42:26
Coffee With Developers • over 1 year ago

How to Avoid LLM Pitfalls - Mete Atamel and Guillaume Laforge

Meta Atamel, Guillaume Laforge

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.