WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2026 Europe • Jul 9, 2026 • Session details

Back to the Roots: Testing in the Age of AI

Jakub Janczyk

AI effortlessly generates tests, but blindly trusting them creates a dangerous illusion of coverage. Reclaim your application's intent with foundational testing principles for robust, cost-effective code.

Pause
Mute Enter Fullscreen
#1 about 3 min

The evolving role of software testing in AI development

AI reduces the cost of writing code significantly while elevating the critical strategic importance of test design.

#2 about 2 min

Avoiding the trap of AI self-verification loops

Relying on autonomous agents to compose both internal implementation details and tests often masks underlying logic hallucinations.

#3 about 2 min

Four essential jobs of a high-quality test

Structuring tests securely around clear feedback, strict specification, broad context, and safe guardrails guides autonomous coding agents effectively.

#4 about 2 min

Providing unambiguous testing signals to AI agents

Applying fundamental testing principles proactively prevents automated agents from guessing aimlessly due to ambiguous or flaky feedback.

#5 about 2 min

Identifying lying tests and avoiding false operational confidence

Poorly defined test assertions ultimately fail to catch actual software errors despite incorrectly reporting extremely high code coverage.

#6 about 3 min

Defining precise behavior scenarios to prompt coding agents

Writing rigorous initial test scenarios before tackling technical implementation establishes a reliable conceptual target for robust code generation.

#7 about 3 min

Decoupling test behavior from specific implementation details

Avoiding tight coupling to internal modules guarantees that executable architectural specifications survive aggressive functional application refactoring.

#8 about 3 min

The critical importance of observing a test fail

Confirming a genuine test failure state carefully before allowing an agent to complete the implementation ensures long-term test validity.

#9 about 4 min

Comparing human-led versus AI-led test ownership

Experimental practical results expose how human-defined tests enable seamless broad refactoring in stark contrast to brittle AI-generated suites.

#10 about 2 min

Tests as structured operational memory for coding agents

Leveraging readable domain-specific language tests maintains long-term project configuration context far better than transient standard chat prompts.

#11 about 3 min

Managing AI token costs through strategic test design

Keeping discrete test files small and minimizing redundant boilerplate cuts cumulative API billing metrics and overall agent processing time.

#12 about 2 min

Preventing AI scaling traps and excessive code mocking

Establishing strong foundational architectural templates early rapidly curbs an autonomous agent's tendency to replicate messy patterns and overuse mocks.

#13 about 3 min

Retaining human intent while delegating software implementation

Maintaining absolute functional control over intended software behavior makes it inherently safer to grant coding agents broader operational autonomy.

#14 about 3 min

Enforcing behavioral testing patterns in AI development tools

Guiding automated AI tools iteratively through test-driven logic preserves long-term structural predictability using established core behavioral testing patterns.

Matching moments

1:48 min

The future landscape of artificial intelligence in software testing

Alisa Hrustic Alisa Hrustic · Europe 2026 Virtual

5:56 min

Five common failure patterns in AI-generated software tests

Maish Saidel-Keesing Maish Saidel-Keesing · World Congress 2026 Europe

2:35 min

Recognizing developer fatigue and poor test generation issues

Lilia Gargouri Lilia Gargouri · World Congress 2026 Europe

3:06 min

Key takeaways for reliable AI agent testing

Sebastian Messingfeld Sebastian Messingfeld · World Congress 2026 Europe

2:27 min

Using automated tests to validate AI generated codebases

YK Sugi YK Sugi · World Congress 2025

4:10 min

Essential checklist for reliable AI-generated test suites

Maish Saidel-Keesing Maish Saidel-Keesing · World Congress 2026 Europe

More from World Congress 2026 Europe

Building the Nervous System of AI - Michael Kagan (NVIDIA) thumbnail
29:17
about 2 months ago

Building the Nervous System of AI - Michael Kagan (NVIDIA)

Michael Kagan, Sead Ahmetović

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote thumbnail
19:41
about 2 months ago

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote

Christian Heilmann

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend thumbnail
32:06
about 2 months ago

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend

David vonThenen

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes thumbnail
35:13
about 2 months ago

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes

Irina Branovic

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬 thumbnail
24:23
about 2 months ago

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬

Jeremy Murray

Angstfreude - AI and Corporate Culture - The Thrill and the Threat thumbnail
30:26
about 2 months ago

Angstfreude - AI and Corporate Culture - The Thrill and the Threat

Axel Ebert, Karin Krobath

Upcoming sessions on this topic

Open session

World Congress 2026 North America

September 25, 2026 · 11:40–12:10

Stage 2

Reinventing Testing Practices in the AI Era

Eric Deandrea

Java Champion & Senior Principal Software Engineer at IBM

Eric Deandrea
Open session

World Congress 2026 North America

September 24, 2026 · 16:50–17:20

Stage 6

Who Tests the AI? Building Trustworthy AI Systems at Enterprise Scale

Him Raj Singh

Manager, Software Engineer at PayPal

Him Raj Singh
Open session

World Congress 2026 North America

September 25, 2026 · 13:30–14:00

Stage 7

Agents Can't Iterate Against Tests That Lie

Rocky Warren

Senior Staff Software Engineer at Clipboard

Rocky Warren
Open session

World Congress 2026 North America

September 25, 2026 · 14:50–15:20

Tech Leaders Stage

Keeping Code Quality at AI Speed

Daksh Gupta, Arthur Hicken, Brian Mann

Daksh Gupta
Arthur Hicken
Brian Mann
Open session

World Congress 2026 North America

September 25, 2026 · 14:10–14:40

Stage 1

The Broken Rung: How AI is Rebuilding Software Development from the Ground Up

Tomislav Tipurić

Chief Technology Officer, Nephos

Tomislav Tipurić
Open session

World Congress 2026 North America

September 24, 2026 · 15:30–16:00

Mainstage

Our Brains in the AI Era

Cassidy Williams

Senior Director of Developer Advocacy, GitHub

Cassidy Williams

Related videos

Your Tests Are Lying to You: Let AI Expose What You Missed thumbnail
26:12
World Congress 2026 Europe • 2 months ago

Your Tests Are Lying to You: Let AI Expose What You Missed

Maish Saidel-Keesing

AI as a Test Designer: Transforming Experience into Automated Testing thumbnail
30:46
Europe 2026 Virtual • 2 months ago

AI as a Test Designer: Transforming Experience into Automated Testing

Alisa Hrustic

The Last Mile of AI: From Prototype to Production thumbnail
28:23
World Congress 2026 Europe • about 2 months ago

The Last Mile of AI: From Prototype to Production

Clemens Wasner, Holger Hammel, Martin Remmelgas, Max Jacobson, Marius Cosareanu

Let’s Talk Quality! thumbnail
27:29
World Congress 2026 Europe • 2 months ago

Let’s Talk Quality!

Lilia Gargouri

11 Principles for Evaluating AI Dev Tools thumbnail
30:46
World Congress 2026 Europe • about 2 months ago

11 Principles for Evaluating AI Dev Tools

Nnenna Ndukwe

How will artificial intelligence change the future of software testing? thumbnail
45:24
LIVE • almost 6 years ago

How will artificial intelligence change the future of software testing?

Evelyn Haslinger

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.