> Markdown version of [/events/world-congress-2026-europe/sessions/1329-there-is-no-such](https://www.wearedevelopers.com/events/world-congress-2026-europe/sessions/1329-there-is-no-such). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# There Is No Such Thing as a Fair DBaaS Benchmark


- **Date:** Friday, Jul 10, 2026
- **Time:** 13:40–14:10 (30 min)
- **Room:** Stage 10 - powered by TikTok
- **Event:** World Congress 2026 Europe

## Recording

[Watch recording](https://www.wearedevelopers.com/videos/100287-there-is-no-such-thing-as-a-fair-dbaas-benchmark)

## Description

If you’ve ever tried to benchmark a managed database, you know the frustration: same vCPU, same RAM, same PostgreSQL version — and completely different results.

Designing a “fair” DBaaS benchmark today is not just about query workloads and metrics. It’s about understanding hidden IO limits, burst credits, storage backends, noisy neighbors, throttling behavior, and pricing tiers that influence performance in ways your dashboard doesn’t show.

In this talk, we break down what “fair” actually means in practice. Should you compare systems at equal cost, equal resources, or equal performance targets? Each approach answers a different engineering question — and can lead to opposite conclusions.

Using real-world examples from benchANT benchmarking projects, we’ll show where common benchmarking assumptions fail, how cloud abstractions distort performance expectations, and why reproducibility alone doesn’t guarantee comparability.

You’ll leave with practical guidance on how to design benchmarks that reflect production reality — so you can evaluate DBaaS platforms based on engineering truth, not marketing claims.

## Speaker

### [Daniel Seybold](https://www.wearedevelopers.com/@daniel-seybold)

Co-Founder of benchANT


## Related talks at this congress

- [Hands-On Strategies for Cost-Effective Performance](https://www.wearedevelopers.com/events/world-congress-2026-europe/sessions/1659-hands-on-strategies) — Nati Cohen
- [TiDB, One Layer at a Time: How Distributed SQL Became an Agentic AI Backbone](https://www.wearedevelopers.com/events/world-congress-2026-europe/sessions/1119-tidb-one-layer-at-a) — Daniël van Eeden, Mattias Jonsson
- [Rate-limiting using eBPF and Istio: How to protect your SaaS customers from themselves](https://www.wearedevelopers.com/events/world-congress-2026-europe/sessions/1251-rate-limiting-using) — Jan Mensch
- [11 Principles for Evaluating AI Dev Tools](https://www.wearedevelopers.com/events/world-congress-2026-europe/sessions/1346-11-principles-for) — Nnenna Ndukwe