WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2026 Europe • Jul 10, 2026 • Session details

There Is No Such Thing as a Fair DBaaS Benchmark

Daniel Seybold

Think matching vCPUs ensures a fair DBaaS benchmark? Discover why hidden cloud limitations skew results and how to design tests that reveal actual cost-performance metrics.

Pause
Mute Enter Fullscreen
#1 about 3 min

Establishing definitions for database performance benchmarking

Different perspectives on performance assessment range from mysterious experiments to formal methodology.

#2 about 4 min

Evolution of database landscapes and testing complexity

The shift from appliances to managed and serverless platforms complicates system comparability.

#3 about 2 min

Core principles for valid database performance tests

Transparent setups, reproducible scripts, and public raw data form the foundation of credible evaluation.

#4 about 3 min

Designing fair approaches for cloud database comparisons

Methodologies must choose between equal resources, equal costs, equal performance, or pinpointed workload models.

#5 about 6 min

Understanding hardware disparities in resource equal setups

Seemingly identical specifications yield varied baseline performance due to underlying compute chip architectures.

#6 about 2 min

Impact of aligning systems by equivalent costs

Standardizing on computing budget necessitates comparing highly heterogeneous virtual instances and storage tiers.

#7 about 6 min

Evaluating serverless against dedicated database cost models

Accurately pricing pay-per-use architectures requires mapping expected operational throughput over explicit duration models.

#8 about 3 min

Making benchmarking objectives explicit for valid comparisons

Maintaining fairness demands strictly bounded scopes, disclosed technical implementations, and raw data transparency.

Matching moments

3:50 min

Benchmarking cloud data warehouses under concurrent artificial user load

Adnan Rahic · JS Congress

2:04 min

The gap between research benchmarks and industry application

Nico Axtmann · WWC 2022

2:08 min

Adapting productivity metrics for non-traditional deployment contexts

Justin Reock Justin Reock · WWC Europe 2026

40 sec

Introduction to managed database-as-a-service concepts

Gregor Bauer Gregor Bauer · LIVE

3:30 min

Addressing framework comparisons, third-party libraries, and performance benchmarks

Codrina Merigo · WWC 2023

7:52 min

Audience questions on database performance, deployments, and data migrations

Gregor Bauer Gregor Bauer · LIVE

More from World Congress 2026 Europe

Building the Nervous System of AI - Michael Kagan (NVIDIA) thumbnail
29:17
about 1 month ago

Building the Nervous System of AI - Michael Kagan (NVIDIA)

Michael Kagan, Sead Ahmetović

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote thumbnail
19:41
about 1 month ago

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote

Christian Heilmann

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend thumbnail
32:06
about 1 month ago

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend

David vonThenen

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes thumbnail
35:13
about 1 month ago

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes

Irina Branovic

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬 thumbnail
24:23
about 1 month ago

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬

Jeremy Murray

Angstfreude - AI and Corporate Culture - The Thrill and the Threat thumbnail
30:26
about 1 month ago

Angstfreude - AI and Corporate Culture - The Thrill and the Threat

Axel Ebert, Karin Krobath

Upcoming sessions on this topic

Open session

World Congress 2026 North America

public void saveMoney(AI): The Developer's Guide to Unit Economics

Hrushikesh Pokala

Senior Software Engineer Lead at Equifax

Hrushikesh Pokala
Open session

World Congress 2026 North America

Databases in the Agent Era

Monica Sarbu

Founder and CEO of xata.io

Monica Sarbu
Open session

World Congress 2026 North America

Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases

Wei Hu

Senior Vice President of Research and Development

Wei Hu
Open session

World Congress 2026 North America

Testing React Backends Like a Pro: Mocking Databases with SQLite

David Morris

Solution Architect

David Morris
Open session

World Congress 2026 North America

How to generate business value through performance optimizations

Nikolai Sidiropulo

Software Engineer at Meta

Nikolai Sidiropulo
Open session

World Congress 2026 North America

Evals Are Infra: Building AI Systems Developers Can Actually Trust

Phoebe Wang

Member of Technical Staff at OpenAI

Phoebe Wang

Related videos

How building an industry DBMS differs from building a research one thumbnail
30:34
WWC 2023 • almost 3 years ago

How building an industry DBMS differs from building a research one

Markus Dreseler

Tomorrow's cloud data platforms - fully managed database-as-a-service (DBaaS) thumbnail
43:28
LIVE • almost 5 years ago

Tomorrow's cloud data platforms - fully managed database-as-a-service (DBaaS)

Gregor Bauer

Leveraging Real time data in FSIs thumbnail
41:51
LIVE • over 2 years ago

Leveraging Real time data in FSIs

Tim Faulkes

Making Data Warehouses fast. A developer's story. thumbnail
42:16
JS Congress • over 4 years ago

Making Data Warehouses fast. A developer's story.

Adnan Rahic

The New Shiny Syndrome: How to Avoid Tech Hype Traps thumbnail
31:27
WWC Europe 2026 • about 1 month ago

The New Shiny Syndrome: How to Avoid Tech Hype Traps

Josip Stuhli

Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases thumbnail
28:41
WWC 2025 • 12 months ago

Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases

Wei Hu

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.