WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2026 Europe β€’ Jul 10, 2026 β€’ Session details

There Is No Such Thing as a Fair DBaaS Benchmark

Daniel Seybold

Think matching vCPUs ensures a fair DBaaS benchmark? Discover why hidden cloud limitations skew results and how to design tests that reveal actual cost-performance metrics.

Pause
Mute Enter Fullscreen
#1 about 3 min

Establishing definitions for database performance benchmarking

Different perspectives on performance assessment range from mysterious experiments to formal methodology.

#2 about 4 min

Evolution of database landscapes and testing complexity

The shift from appliances to managed and serverless platforms complicates system comparability.

#3 about 2 min

Core principles for valid database performance tests

Transparent setups, reproducible scripts, and public raw data form the foundation of credible evaluation.

#4 about 3 min

Designing fair approaches for cloud database comparisons

Methodologies must choose between equal resources, equal costs, equal performance, or pinpointed workload models.

#5 about 6 min

Understanding hardware disparities in resource equal setups

Seemingly identical specifications yield varied baseline performance due to underlying compute chip architectures.

#6 about 2 min

Impact of aligning systems by equivalent costs

Standardizing on computing budget necessitates comparing highly heterogeneous virtual instances and storage tiers.

#7 about 6 min

Evaluating serverless against dedicated database cost models

Accurately pricing pay-per-use architectures requires mapping expected operational throughput over explicit duration models.

#8 about 3 min

Making benchmarking objectives explicit for valid comparisons

Maintaining fairness demands strictly bounded scopes, disclosed technical implementations, and raw data transparency.

Matching moments

3:50 min

Benchmarking cloud data warehouses under concurrent artificial user load

Adnan Rahic Β· JS Congress

2:04 min

The gap between research benchmarks and industry application

Nico Axtmann Β· World Congress 2022

2:08 min

Adapting productivity metrics for non-traditional deployment contexts

Justin Reock Justin Reock Β· World Congress 2026 Europe

40 sec

Introduction to managed database-as-a-service concepts

Gregor Bauer Gregor Bauer Β· LIVE

3:30 min

Addressing framework comparisons, third-party libraries, and performance benchmarks

Codrina Merigo Β· World Congress 2023

7:52 min

Audience questions on database performance, deployments, and data migrations

Gregor Bauer Gregor Bauer Β· LIVE

More from World Congress 2026 Europe

Building the Nervous System of AI - Michael Kagan (NVIDIA) thumbnail
29:17
about 2 months ago

Building the Nervous System of AI - Michael Kagan (NVIDIA)

Michael Kagan, Sead Ahmetović

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote thumbnail
19:41
about 2 months ago

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote

Christian Heilmann

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend thumbnail
32:06
about 2 months ago

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend

David vonThenen

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes thumbnail
35:13
about 2 months ago

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes

Irina Branovic

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬 thumbnail
24:23
about 2 months ago

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬

Jeremy Murray

Angstfreude - AI and Corporate Culture - The Thrill and the Threat thumbnail
30:26
about 2 months ago

Angstfreude - AI and Corporate Culture - The Thrill and the Threat

Axel Ebert, Karin Krobath

Upcoming sessions on this topic

Open session

World Congress 2026 North America

September 25, 2026 Β· 16:50–17:20

Stage 4

Engineering Moneyball: How We Benchmarked Google vs Meta

Jirka Bachel

Co-Founder & CEO

Jirka Bachel
Open session

World Congress 2026 North America

September 25, 2026 Β· 16:00–16:10

Outdoor Stage

public void saveMoney(AI): The Developer's Guide to Unit Economics

Hrushikesh Pokala

Senior Software Engineer Lead at Equifax

Hrushikesh Pokala
Open session

World Congress 2026 North America

September 24, 2026 Β· 14:50–15:20

Stage 2

Databases in the Agent Era

Monica Sarbu

Founder and CEO of xata.io

Monica Sarbu
Open session

World Congress 2026 North America

September 24, 2026 Β· 12:50–13:20

Stage 3

Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases

Wei Hu

Senior Vice President of Research and Development

Wei Hu
Open session

World Congress 2026 North America

September 25, 2026 Β· 10:20–10:50

Stage 9

Testing React Backends Like a Pro: Mocking Databases with SQLite

David Morris

Solution Architect

David Morris
Open session

World Congress 2026 North America

September 24, 2026 Β· 14:50–15:20

Stage 9

How to generate business value through performance optimizations

Nikolai Sidiropulo

Software Engineer at Meta

Nikolai Sidiropulo

Related videos

How building an industry DBMS differs from building a research one thumbnail
30:34
World Congress 2023 β€’ almost 3 years ago

How building an industry DBMS differs from building a research one

Markus Dreseler

Tomorrow's cloud data platforms - fully managed database-as-a-service (DBaaS) thumbnail
43:28
LIVE β€’ almost 5 years ago

Tomorrow's cloud data platforms - fully managed database-as-a-service (DBaaS)

Gregor Bauer

Leveraging Real time data in FSIs thumbnail
41:51
LIVE β€’ almost 3 years ago

Leveraging Real time data in FSIs

Tim Faulkes

Making Data Warehouses fast. A developer's story. thumbnail
42:16
JS Congress β€’ almost 5 years ago

Making Data Warehouses fast. A developer's story.

Adnan Rahic

The New Shiny Syndrome: How to Avoid Tech Hype Traps thumbnail
31:27
World Congress 2026 Europe β€’ about 2 months ago

The New Shiny Syndrome: How to Avoid Tech Hype Traps

Josip Stuhli

Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases thumbnail
28:41
World Congress 2025 β€’ about 1 year ago

Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases

Wei Hu

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.