WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2026 Europe • Jul 9, 2026 • Session details

Beyond LLM Agents: A World Model for Visual Software Testing

Manuel Weichselbaum

Real-world software testing demands deterministic results, not fragile LLM agents. Discover how a lightweight visual world model securely automates UI tests on standard CPUs without prompt vulnerabilities.

Pause
Mute Enter Fullscreen
#1 about 1 min

Limitations of current performance benchmarks for agentic AI

Shifting the evaluation goalpost from single-task execution to reliable, repeatable automation reveals weaknesses in saturated performance benchmarks.

#2 about 1 min

Challenges of grindable parallel rollouts in UI testing

Executing thousands of AI interactions against real-world webpages requires grindable systems rather than just verifiable actions.

#3 about 1 min

Abstracting UI interactions for secure and automated execution

Mapping a core concept library of abstracted behavior prevents prompt injections while reducing computing overhead.

#4 about 2 min

Vision action model architecture for visual software testing

Utilizing simple visual targets and sigmoid activation creates reliable confidence signals for autonomous bug detection.

#5 about 1 min

Comparing model scale and operational computation costs

Deploying a specialized vision model at a fraction of typical sizes retains benchmark compatibility while reducing infrastructure costs.

Matching moments

3:30 min

Applying visual language models for automated self-healing tests

Daniel Afonso Daniel Afonso · WWC 2025

5:27 min

Evaluating AI agents through unpredictable behavior and logic tests

Chris Heilmann +2 · LIVE

3:46 min

Integrating AI into web performance engineering workflows

Perf + AI

1:21 min

Handling screen reader simulations using AI agents

Jörg Jakoby Jörg Jakoby · WWC Europe 2026

50 sec

Introduction to AskUI and vision agent capabilities

Jonas Menesklou Jonas Menesklou · WWC 2025

2:20 min

Validating user experiences directly with automated QA agents

Ohans Emmanuel Ohans Emmanuel · WWC Europe 2026

More from World Congress 2026 Europe

Building the Nervous System of AI - Michael Kagan (NVIDIA) thumbnail
29:17
about 1 month ago

Building the Nervous System of AI - Michael Kagan (NVIDIA)

Michael Kagan, Sead Ahmetović

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote thumbnail
19:41
about 1 month ago

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote

Christian Heilmann

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend thumbnail
32:06
about 1 month ago

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend

David vonThenen

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes thumbnail
35:13
about 1 month ago

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes

Irina Branovic

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬 thumbnail
24:23
about 1 month ago

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬

Jeremy Murray

Angstfreude - AI and Corporate Culture - The Thrill and the Threat thumbnail
30:26
about 1 month ago

Angstfreude - AI and Corporate Culture - The Thrill and the Threat

Axel Ebert, Karin Krobath

Upcoming sessions on this topic

Open session

World Congress 2026 North America

Closing the Visibility Gap: Lessons from Safety Critical Agentic Systems

Vivek Pandit

Principal Engineer at Cadence

Vivek Pandit
Open session

World Congress 2026 North America

No Single Model to Rule Them All: Building Resilient AI Agents Across Open & Closed LLMs

Emmanuel Acheampong

Senior Manager Developer Relations at Crusoe AI

Emmanuel Acheampong
Open session

World Congress 2026 North America

Reinventing Testing Practices in the AI Era

Eric Deandrea

Java Champion & Senior Principal Software Engineer, IBM

Eric Deandrea
Open session

World Congress 2026 North America

From Software Agents to Physical Devices: Inside the Agentic Hardware Stack

Michael Yuan, Vivian Hu

Michael Yuan
Vivian Hu
Open session

World Congress 2026 North America

Give the Agent a Budget, Not a Token

Sachin Malhotra

MTS @Anthropic

Sachin Malhotra
Open session

World Congress 2026 North America

You Can’t Re-Run Sunlight: Designing ML Data Architectures for Physical AI

An Phan

Senior Data Infrastructure Engineer @ Hippo Harvest

An Phan

Related videos

Are Classical Automation Frameworks Dead? How AI Agents Are Transforming QA thumbnail
26:39
WWC Europe 2026 • about 1 month ago

Are Classical Automation Frameworks Dead? How AI Agents Are Transforming QA

Andrei Nutas

AskUI - How to leverage Vision Agents for Test Automation thumbnail
4:42
WWC 2025 • 12 months ago

AskUI - How to leverage Vision Agents for Test Automation

Jonas Menesklou

Giving AI eyes: How to build a dashboard you can't see thumbnail
27:04
WWC Europe 2026 • about 1 month ago

Giving AI eyes: How to build a dashboard you can't see

Josh Hobson

Beyond the IDE: A new era of agent collaboration thumbnail
27:12
WWC 2025 • 12 months ago

Beyond the IDE: A new era of agent collaboration

Ryan J. Salva

Testing AI Agents: Automated Evaluation for Chatbots & RAG Systems thumbnail
30:34
WWC Europe 2026 • about 1 month ago

Testing AI Agents: Automated Evaluation for Chatbots & RAG Systems

Sebastian Messingfeld

Building Agents Securely at Scale - Alfonso Graziano thumbnail
31:49
Coffee With Developers • 4 months ago

Building Agents Securely at Scale - Alfonso Graziano

Alfonso Graziano

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.