WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2026 Europe • Jul 9, 2026 • Session details

Your Tests Are Lying to You: Let AI Expose What You Missed

Maish Saidel-Keesing

Are your AI-generated tests creating a dangerous false sense of security? Discover how specification-driven prompting and mutation testing expose the critical business logic your automated suites missed.

Pause
Mute Enter Fullscreen
#1 about 3 min

The false sense of security in AI-generated test coverage

High test coverage metrics from AI models often miss critical business logic and unexpected edge cases.

#2 about 6 min

Five common failure patterns in AI-generated software tests

AI testing frequently fails through tautological assertions, API hallucinations, aggressive over-mocking, and generic assumptions.

#3 about 2 min

Prompting AI with specifications instead of application code

Feeding detailed business requirements into AI tools generates comprehensive test suites rather than simple generic assertions.

#4 about 4 min

Scaling test generation with cascading specification tiers

Stacking system, domain, and function-level rules creates reusable building blocks that automatically enforce comprehensive architectural standards.

#5 about 5 min

Essential checklist for reliable AI-generated test suites

A practical framework guides engineers through optimal mutation thresholds, edge-case probing questions, and appropriate integration testing boundaries.

#6 about 3 min

Evaluating AI test effectiveness using human judgment and traceability

Human oversight remains essential to ensure generated code maps directly to business requirements instead of functioning as mere coverage decoration.

#7 about 5 min

Implementing specification-driven AI testing in thirty minutes

A rapid workflow demonstrates writing functional requirements, prompting generative capabilities, and validating the output using mutation metrics.

Matching moments

3:45 min

Comparing human-led versus AI-led test ownership

Jakub Janczyk Jakub Janczyk · World Congress 2026 Europe

2:27 min

Using automated tests to validate AI generated codebases

YK Sugi YK Sugi · World Congress 2025

2:22 min

Why AI-generated unit tests fail to validate requirements

Maish Saidel-Keesing Maish Saidel-Keesing · World Congress 2026 Europe

1:48 min

The future landscape of artificial intelligence in software testing

Alisa Hrustic Alisa Hrustic · Europe 2026 Virtual

2:12 min

The evolving role of software testing in AI development

Jakub Janczyk Jakub Janczyk · World Congress 2026 Europe

2:35 min

Recognizing developer fatigue and poor test generation issues

Lilia Gargouri Lilia Gargouri · World Congress 2026 Europe

More from World Congress 2026 Europe

Building the Nervous System of AI - Michael Kagan (NVIDIA) thumbnail
29:17
2 months ago

Building the Nervous System of AI - Michael Kagan (NVIDIA)

Michael Kagan, Sead Ahmetović

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote thumbnail
19:41
2 months ago

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote

Christian Heilmann

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend thumbnail
32:06
2 months ago

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend

David vonThenen

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes thumbnail
35:13
2 months ago

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes

Irina Branovic

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬 thumbnail
24:23
2 months ago

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬

Jeremy Murray

Angstfreude - AI and Corporate Culture - The Thrill and the Threat thumbnail
30:26
2 months ago

Angstfreude - AI and Corporate Culture - The Thrill and the Threat

Axel Ebert, Karin Krobath

Upcoming sessions on this topic

Open session

World Congress 2026 North America

September 25, 2026 · 11:40–12:10

Stage 2

Reinventing Testing Practices in the AI Era

Eric Deandrea

Java Champion & Senior Principal Software Engineer at IBM

Eric Deandrea
Open session

World Congress 2026 North America

September 24, 2026 · 16:50–17:20

Stage 6

Who Tests the AI? Building Trustworthy AI Systems at Enterprise Scale

Him Raj Singh

Manager, Software Engineer at PayPal

Him Raj Singh
Open session

World Congress 2026 North America

September 24, 2026 · 15:10–15:20

Outdoor Stage

AI That Argues With Itself: Building Self-Debating Systems That Catch Their Own Bugs

Shreya Singhal

AI Applied Scientist at Claritev

Shreya Singhal
Open session

World Congress 2026 North America

September 24, 2026 · 11:20–11:25

Outdoor Stage

Finding the Edges: Testing, Evaluating, and Monitoring Voice AI Agents Before Your Users Do

Matt Wyman

CEO of Okareo

Matt Wyman
Open session

World Congress 2026 North America

September 24, 2026 · 15:30–16:00

Stage 5

The reviewer can't be the author: independent verification for AI-generated code

Manish Kapur

VP, Product and Solutions at Sonar

Manish Kapur
Open session

World Congress 2026 North America

September 25, 2026 · 14:10–14:40

Stage 1

The Broken Rung: How AI is Rebuilding Software Development from the Ground Up

Tomislav Tipurić

Chief Technology Officer, Nephos

Tomislav Tipurić

Related videos

Back to the Roots: Testing in the Age of AI thumbnail
29:50
World Congress 2026 Europe • 2 months ago

Back to the Roots: Testing in the Age of AI

Jakub Janczyk

AI as a Test Designer: Transforming Experience into Automated Testing thumbnail
30:46
Europe 2026 Virtual • 2 months ago

AI as a Test Designer: Transforming Experience into Automated Testing

Alisa Hrustic

How will artificial intelligence change the future of software testing? thumbnail
45:24
LIVE • almost 6 years ago

How will artificial intelligence change the future of software testing?

Evelyn Haslinger

Let’s Talk Quality! thumbnail
27:29
World Congress 2026 Europe • 2 months ago

Let’s Talk Quality!

Lilia Gargouri

Truth, Lies, and Probabilities: Testing AI Hallucinations thumbnail
32:14
World Congress 2026 Europe • 2 months ago

Truth, Lies, and Probabilities: Testing AI Hallucinations

Anastasia Simou

The Hidden Cost of AI Coding: Technical Debt You Can’t See thumbnail
34:48
World Congress 2026 Europe • 2 months ago

The Hidden Cost of AI Coding: Technical Debt You Can’t See

Maish Saidel-Keesing

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.