WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2026 Europe • Jul 9, 2026 • Session details

Your Tests Are Lying to You: Let AI Expose What You Missed

Maish Saidel-Keesing

Are your AI-generated tests creating a dangerous false sense of security? Discover how specification-driven prompting and mutation testing expose the critical business logic your automated suites missed.

Pause
Mute Enter Fullscreen
#1 about 3 min

The false sense of security in AI-generated test coverage

High test coverage metrics from AI models often miss critical business logic and unexpected edge cases.

#2 about 6 min

Five common failure patterns in AI-generated software tests

AI testing frequently fails through tautological assertions, API hallucinations, aggressive over-mocking, and generic assumptions.

#3 about 2 min

Prompting AI with specifications instead of application code

Feeding detailed business requirements into AI tools generates comprehensive test suites rather than simple generic assertions.

#4 about 4 min

Scaling test generation with cascading specification tiers

Stacking system, domain, and function-level rules creates reusable building blocks that automatically enforce comprehensive architectural standards.

#5 about 5 min

Essential checklist for reliable AI-generated test suites

A practical framework guides engineers through optimal mutation thresholds, edge-case probing questions, and appropriate integration testing boundaries.

#6 about 3 min

Evaluating AI test effectiveness using human judgment and traceability

Human oversight remains essential to ensure generated code maps directly to business requirements instead of functioning as mere coverage decoration.

#7 about 5 min

Implementing specification-driven AI testing in thirty minutes

A rapid workflow demonstrates writing functional requirements, prompting generative capabilities, and validating the output using mutation metrics.

Matching moments

3:45 min

Comparing human-led versus AI-led test ownership

Jakub Janczyk Jakub Janczyk · WWC Europe 2026

2:27 min

Using automated tests to validate AI generated codebases

YK Sugi YK Sugi · WWC 2025

2:22 min

Why AI-generated unit tests fail to validate requirements

Maish Saidel-Keesing Maish Saidel-Keesing · WWC Europe 2026

1:48 min

The future landscape of artificial intelligence in software testing

Alisa Hrustic Alisa Hrustic · Europe 2026 Virtual

2:12 min

The evolving role of software testing in AI development

Jakub Janczyk Jakub Janczyk · WWC Europe 2026

2:35 min

Recognizing developer fatigue and poor test generation issues

Lilia Gargouri Lilia Gargouri · WWC Europe 2026

More from World Congress 2026 Europe

Building the Nervous System of AI - Michael Kagan (NVIDIA) thumbnail
29:17
about 1 month ago

Building the Nervous System of AI - Michael Kagan (NVIDIA)

Michael Kagan, Sead Ahmetović

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote thumbnail
19:41
about 1 month ago

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote

Christian Heilmann

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend thumbnail
32:06
about 1 month ago

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend

David vonThenen

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes thumbnail
35:13
about 1 month ago

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes

Irina Branovic

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬 thumbnail
24:23
about 1 month ago

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬

Jeremy Murray

Angstfreude - AI and Corporate Culture - The Thrill and the Threat thumbnail
30:26
about 1 month ago

Angstfreude - AI and Corporate Culture - The Thrill and the Threat

Axel Ebert, Karin Krobath

Upcoming sessions on this topic

Open session

World Congress 2026 North America

Reinventing Testing Practices in the AI Era

Eric Deandrea

Java Champion & Senior Principal Software Engineer, IBM

Eric Deandrea
Open session

World Congress 2026 North America

Who Tests the AI? Building Trustworthy AI Systems at Enterprise Scale

Him Raj Singh

PayPal, Manager, Software Engineer

Him Raj Singh
Open session

World Congress 2026 North America

AI That Argues With Itself: Building Self-Debating Systems That Catch Their Own Bugs

Shreya Singhal

AI Applied Scientist at Claritev

Shreya Singhal
Open session

World Congress 2026 North America

The Broken Rung: How AI is Rebuilding Software Development from the Ground Up

Tomislav Tipurić

Chief Technology Officer, Nephos

Tomislav Tipurić
Open session

World Congress 2026 North America

The Things Your AI Isn't Telling You

Desmond Lamptey

Lead Software Engineer @ Capital One

Desmond Lamptey
Open session

World Congress 2026 North America

Agents Can't Iterate Against Tests That Lie

Rocky Warren

Senior Staff Software Engineer at Clipboard

Rocky Warren

Related videos

Back to the Roots: Testing in the Age of AI thumbnail
29:50
WWC Europe 2026 • about 1 month ago

Back to the Roots: Testing in the Age of AI

Jakub Janczyk

AI as a Test Designer: Transforming Experience into Automated Testing thumbnail
30:46
Europe 2026 Virtual • about 1 month ago

AI as a Test Designer: Transforming Experience into Automated Testing

Alisa Hrustic

How will artificial intelligence change the future of software testing? thumbnail
45:24
LIVE • over 5 years ago

How will artificial intelligence change the future of software testing?

Evelyn Haslinger

Let’s Talk Quality! thumbnail
27:29
WWC Europe 2026 • about 1 month ago

Let’s Talk Quality!

Lilia Gargouri

Truth, Lies, and Probabilities: Testing AI Hallucinations thumbnail
32:14
WWC Europe 2026 • about 1 month ago

Truth, Lies, and Probabilities: Testing AI Hallucinations

Anastasia Simou

The Hidden Cost of AI Coding: Technical Debt You Can’t See thumbnail
34:48
WWC Europe 2026 • about 1 month ago

The Hidden Cost of AI Coding: Technical Debt You Can’t See

Maish Saidel-Keesing

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.