> Markdown version of [/events/world-congress-2026-europe-virtual-stage/sessions/1614-the-algorithm-that](https://www.wearedevelopers.com/events/world-congress-2026-europe-virtual-stage/sessions/1614-the-algorithm-that). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# The Algorithm That Nearly Killed Me: When Testing Isn't Enough


- **Event:** World Congress 2026 Europe - Virtual Stage

## Recording

[Watch recording](https://www.wearedevelopers.com/videos/2110-the-algorithm-that-nearly-killed-me-when-testing-isn-t-enough)

## Description

When my new insulin pump’s algorithm confidently delivered what it claimed were hefty doses while my blood sugar soared toward dangerous levels, I faced a terrifying reality: the software was learning, but learning the wrong things. And it was utterly convinced it was doing a great job.

This isn’t just a medical device story - it’s a wake-up call for our entire industry. As ML and AI become critical infrastructure, they’re exposing fundamental flaws in how we approach quality. We test implementation rather than behaviour, write tests that validate our assumptions rather than challenge them and mistake comprehensive coverage for genuine safety.

Drawing from 15+ years as a software engineering trainer and consultant across multiple industries, I’ll explore how traditional testing blind spots become genuinely dangerous when systems learn and adapt. We’ll examine why teams confuse feeling safe with being safe, how AI amplifies our existing quality gaps and what it really means to test systems that make decisions affecting real lives.

You’ll leave with practical approaches to testing that focuses on impact over metrics, strategies for validating both deterministic and learning systems, and the essential questions every team should ask when software moves beyond just processing data to making decisions that matter.

Because whether it’s a payment system, a recommendation algorithm or life-critical medical software, our users are trusting us to get it right.

## Speaker

### [Andrew Paul](https://www.wearedevelopers.com/@andrew-paul)

Senior Software Engineer & Trainer, with a passion for education over training!


## Related talks at this congress

- [Simon Says "Format Drive": Convenience Meets Consequences](https://www.wearedevelopers.com/events/world-congress-2026-europe-virtual-stage/sessions/1598-simon-says-format) — Michael Macher, Niels Pfau
- [AI as a Test Designer: Transforming Experience into Automated Testing](https://www.wearedevelopers.com/events/world-congress-2026-europe-virtual-stage/sessions/1482-ai-as-a-test) — Alisa Hrustic
- [AI in Regulated Industry - Validating AI-Enabled Products with PLM and Digital Twins](https://www.wearedevelopers.com/events/world-congress-2026-europe-virtual-stage/sessions/1485-ai-in-regulated) — Murli Mohan Srinivas
- [Load Testing AI: Aiming at a Moving Target](https://www.wearedevelopers.com/events/world-congress-2026-europe-virtual-stage/sessions/1567-load-testing-ai) — Heather Thacker