> Markdown version of [/events/world-congress-2026-north-america/sessions/1700-agents-can-t-iterate](https://www.wearedevelopers.com/events/world-congress-2026-north-america/sessions/1700-agents-can-t-iterate). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Agents Can't Iterate Against Tests That Lie


- **Event:** World Congress 2026 North America

## Description

Between February 2025 and February 2026, coding agents went from writing none of Clipboard's code to nearly all of it. That changed our bottleneck. Writing code got cheap, but proving it worked did not.

The failure mode was not just model quality. It was flaky E2E tests in shared environments that were hard to reproduce. With limited context, agents often reached for the wrong fix: increase the timeout or add a retry.

This talk is a practical case study in rebuilding trust in tests for AI-heavy engineering organizations. I will show the workflow that helped us reduce the share of PRs affected by E2E flakes from 100% to under 15% in six weeks, including the open source libraries and agent skills we built to classify flaky tests, connect to observability signals, and decide which tests to harden, delete, quarantine, or move down the pyramid.

Attendees will leave with a repeatable playbook for making coding agents safe to use at scale without teaching them that every failing test should be "fixed" with retries.

## Speaker

### [Rocky Warren](https://www.wearedevelopers.com/@rocky-warren)

Senior Staff Software Engineer at Clipboard


## Related talks at this congress

- [Your Evals Passed. Your Agent Just Emptied a Database.](https://www.wearedevelopers.com/events/world-congress-2026-north-america/sessions/1684-your-evals-passed) — Tejas Pravinbhai Patel
- [Give the Agent a Budget, Not a Token](https://www.wearedevelopers.com/events/world-congress-2026-north-america/sessions/1695-give-the-agent-a) — Sachin Malhotra
- [Designing APIs That Survive AI Agents at Scale](https://www.wearedevelopers.com/events/world-congress-2026-north-america/sessions/1714-designing-apis-that) — Phani Pendurthi
- [Agentic Drift: keeping pace with your agents](https://www.wearedevelopers.com/events/world-congress-2026-north-america/sessions/1739-agentic-drift) — John Coghlan

## Watch remotely

Can’t make it to San José? Watch this session live with Pro. You also get:

- All full videos, bookmarks, and playlists
- World Congress livestreams

[See pricing](https://www.wearedevelopers.com/pricing)

## Links

- [Get tickets](https://www.wearedevelopers.com/world-congress-north-america/tickets)