WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2026 Europe • Jul 10, 2026 • Session details

The LLM Evolution: From Sequence Imitation to Verifiable Reasoning

Kamen Petroff

What happens to software engineering when AI runs out of human text to imitate? Discover how test-time compute shifts developer roles from writing syntax to architecting rigorous specs.

Pause
Mute Enter Fullscreen
#1 about 3 min

Reaching the limits of imitation in artificial intelligence

The traditional method of scaling language models by continuously appending human data is permanently approaching statistical limits.

#2 about 2 min

Understanding language models as next-token predictors

Mathematical matrices systematically establish precision conditional probability distributions to analyze strings and successfully predict ongoing inputs.

#3 about 2 min

Evaluating statistical models and the bitter lesson

Unrestricted computational strategies massively outperform highly detailed human-engineered rules when scaling broad classification and textual systems.

#4 about 2 min

Neural networks and sequence representation bottlenecks

Word embeddings successfully plot discrete semantic meaning, whereas standard recurrent network architecture encounters severe long-sequence blockages.

#5 about 2 min

Transformers and highly scalable parallel processing

Advanced attention parameters efficiently circumvent sequence restrictions to ultimately unlock monumental parallel hardware scalability and pre-training.

#6 about 3 min

Discovering in-context learning and zero-shot capabilities

Massive scaling curves demonstrate emergent capability frameworks where foundation models natively problem-solve without specialized task formatting.

#7 about 3 min

Instruction fine-tuning and human feedback reinforcement

Models programmatically align toward desired communication metrics after analyzing complex behavioral outcomes guided exclusively via human rewards.

#8 about 1 min

Computing scaling laws and the data bottleneck

Precise mathematical constraints accurately predict ceiling capabilities balancing computing hardware budgets against available structural human dictionaries.

#9 about 2 min

Using test-time compute for verifiable reasoning

Deliberately allocating active analytical generation budgets enables progressive cognitive algorithms to successfully deconstruct problems sequentially.

#10 about 2 min

Replacing human training data with verification

Structured environments boasting strict deterministic parameters prompt algorithms to iteratively self-play until achieving absolute logical mastery.

#11 about 3 min

Training verifiable algorithmic patterns without human input

Automated recursive verifiers heavily reinforce condensed execution code paths enabling raw problem-solving across deterministic mathematics loops.

#12 about 2 min

The verifiers wall and jagged intelligence capabilities

Computational execution currently scales disproportionately toward programmatic sectors where clear objective evaluators reliably grade final outcomes.

#13 about 2 min

Connecting reasoning engines to autonomous coding agents

Interfacing conversational generators with robust executable external APIs organically creates persistent autonomous frameworks capable of programming.

#14 about 3 min

Shifting engineering focus to specifications and testing

Technical workflows shift dynamically from typing base logic components toward designing strict test scaffolding governing automated agents.

#15 about 2 min

Navigating the modern evolution of developer workflows

Architecting reliable acceptance systems anchors machine optimization routines, establishing system validation as the core developer deliverable.

Matching moments

2:38 min

The evolution toward agentic and literate software programming

Neel Sundaresan Neel Sundaresan +1 · WWC Europe 2026

1:56 min

Managing AI speed and the rise of verification debt

Werner Vogels Werner Vogels +1 · WWC Europe 2026

2:37 min

Understanding core parameters and mechanics of large language models

Julián Duque Julián Duque · WWC 2025

4:28 min

Evolution of AI models into autonomous agents

Philipp Schmid Philipp Schmid · WWC 2025

3:55 min

Evaluating generative AI capabilities and physical reasoning limitations

Jonas Andrulis Jonas Andrulis · WWC 2024

3:01 min

Balancing artificial intelligence tools with foundational software engineering skills

Tim Ruscica · Coffee With Developers

More from World Congress 2026 Europe

Building the Nervous System of AI - Michael Kagan (NVIDIA) thumbnail
29:17
about 1 month ago

Building the Nervous System of AI - Michael Kagan (NVIDIA)

Michael Kagan, Sead Ahmetović

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote thumbnail
19:41
about 1 month ago

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote

Christian Heilmann

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend thumbnail
32:06
about 1 month ago

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend

David vonThenen

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes thumbnail
35:13
about 1 month ago

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes

Irina Branovic

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬 thumbnail
24:23
about 1 month ago

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬

Jeremy Murray

Angstfreude - AI and Corporate Culture - The Thrill and the Threat thumbnail
30:26
about 1 month ago

Angstfreude - AI and Corporate Culture - The Thrill and the Threat

Axel Ebert, Karin Krobath

Upcoming sessions on this topic

Open session

World Congress 2026 North America

When Humans Stop Writing Code: Rethinking Languages, Compilers, and Responsibility

Simon Auer

Organizer of flutter vienna meetup and CEO of marqably

Simon Auer
Open session

World Congress 2026 North America

You Can’t Re-Run Sunlight: Designing ML Data Architectures for Physical AI

An Phan

Senior Data Infrastructure Engineer @ Hippo Harvest

An Phan
Open session

World Congress 2026 North America

Building Stuff with GenAI - The Open Minded Workshop beyond OpenAI

Andreas Erben

CTO for Applied AI and Metaverse at daenet

Andreas Erben
Open session

World Congress 2026 North America

Reinventing Testing Practices in the AI Era

Eric Deandrea

Java Champion & Senior Principal Software Engineer, IBM

Eric Deandrea
Open session

World Congress 2026 North America

AI That Argues With Itself: Building Self-Debating Systems That Catch Their Own Bugs

Shreya Singhal

AI Applied Scientist at Claritev

Shreya Singhal
Open session

World Congress 2026 North America

The Broken Rung: How AI is Rebuilding Software Development from the Ground Up

Tomislav Tipurić

Chief Technology Officer, Nephos

Tomislav Tipurić

Related videos

The shadows of reasoning – new design paradigms for a gen AI world thumbnail
25:14
WWC 2024 • almost 2 years ago

The shadows of reasoning – new design paradigms for a gen AI world

Jonas Andrulis

How AI Models Get Smarter thumbnail
35:16
WWC 2025 • about 1 year ago

How AI Models Get Smarter

Ankit Patel

When Humans Stop Writing Code: Rethinking Languages, Compilers, and Responsibility thumbnail
27:52
WWC Europe 2026 • about 1 month ago

When Humans Stop Writing Code: Rethinking Languages, Compilers, and Responsibility

Simon Auer

Stop Parsing Strings: Treating LLMs Like Type-Safe Microservices thumbnail
30:55
WWC Europe 2026 • about 1 month ago

Stop Parsing Strings: Treating LLMs Like Type-Safe Microservices

André Behrens

You are not an AI developer thumbnail
23:55
WWC 2024 • almost 2 years ago

You are not an AI developer

Zan Markan

Inside the Mind of an LLM thumbnail
27:11
WWC 2025 • 12 months ago

Inside the Mind of an LLM

Emanuele Fabbiani

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.