WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2024 • Aug 20, 2024 • Session details

Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases

Wei Hu

Can your database survive a 'Taylor Swift' traffic spike without sacrificing strong consistency? Discover how distributed SQL resolves extreme data skew and ensures zero-data-loss failovers at internet scale.

Pause
Mute Enter Fullscreen
#1 about 2 min

Evolution of distributed SQL database architectures

The transition from simple key-value systems to scalable databases providing strong consistency and standard SQL capabilities.

#2 about 3 min

Core mechanics of distributed database sharding

How partitioned data across physical locations remains entirely hidden from connecting applications.

#3 about 2 min

Primary use cases for widespread geographical data

Driving massive workload survivability and enforcing regional compliance through strict data sovereignty configurations.

#4 about 2 min

Managing a unified logical database entity

Dividing data into individual actively processing shards that map seamlessly to one system.

#5 about 2 min

Query routing and cross-shard parallel execution

Directing queries accurately to specific partitions or parallelizing commands across all remote instances.

#6 about 4 min

Clustered databases versus native distributed databases

Contrasting tightly-coupled single data center clusters using microsecond networking against independently spaced remote nodes.

#7 about 3 min

Mitigating physical latency with targeted geographical subsets

Overcoming baseline networking constraints by keeping operational data close to the regional consumer.

#8 about 5 min

Meeting banking legal requirements using localized sharding

Fulfilling strict regional data laws without rewriting legacy applications via transparent physical isolation.

#9 about 2 min

Sustaining extreme parallel throughput for internet services

Accelerating hyperscale digital activity targeting sub-millisecond response quotas safely via horizontal resource spreading.

#10 about 2 min

Engineering scale-out architectures specifically for relational queries

Avoiding typical degradation by constructing full relational processing directly over the core rather than mapping abstractions onto object stores.

#11 about 3 min

Configuring dynamic range and consistent hash boundaries

Maximizing index efficiency using specific hash implementations, list variables, and multiple layers of sharding categorization.

#12 about 2 min

Isolating skewed variables using directory-based routing

Segregating highly-requested records to specialized environments separating unbalanced noise from uniform performance paths.

#13 about 1 min

Minimizing geographical latency using active duplicate replication

Copying static reference tables onto every remote shard directly removing massive quantities of cross-environment joins.

#14 about 2 min

Maintaining continuous availability during transient network stalls

Establishing robust connection protocols leveraging specific consensus mathematics minimizing total runtime impact during sudden component losses.

#15 about 4 min

Reducing systemic complexity with universal converged databases

Managing varied structures like spatial geometries concurrently within a single deployment rather than fracturing operations across specialized toolchains.

Matching moments

1:52 min

Evolution of distributed SQL database management systems

Akmal Chaudhri Akmal Chaudhri · LIVE

2:12 min

Architectural benefits of single logical database topologies

Wei Hu Wei Hu · WWC 2025

1:36 min

Evolution from key-value stores to distributed SQL

Wei Hu Wei Hu · WWC 2025

1:55 min

Evaluating criteria for distributed SQL system adoption

Wei Hu Wei Hu · WWC 2025

2:25 min

Distributed SQL properties for agentic AI applications

Daniël van Eeden Daniël van Eeden +1 · WWC Europe 2026

52 sec

Defining the core mechanics of distributed databases

Wei Hu Wei Hu · WWC 2025

More from World Congress 2024

Beyond the Hype: Real-World AI Strategies Panel thumbnail
24:07
10 months ago

Beyond the Hype: Real-World AI Strategies Panel

Mike Butcher, Jürgen Müller, Katrin Lehmann, Tobias Regenfuss

Carl Lapierre - Exploring Advanced Patterns in Retrieval-Augmented Generation thumbnail
21:17
almost 2 years ago

Carl Lapierre - Exploring Advanced Patterns in Retrieval-Augmented Generation

Carl Lapierre

Coding an Immersive Copilot using Unity / .NET and Azure OpenAI! thumbnail
31:50
almost 2 years ago

Coding an Immersive Copilot using Unity / .NET and Azure OpenAI!

Zaid Zaim

Building a diverse tech company: The power of Diversity, Equity, Inclusion, and Belonging thumbnail
29:43
almost 2 years ago

Building a diverse tech company: The power of Diversity, Equity, Inclusion, and Belonging

Sue Quackenbush

Dapr in Practice thumbnail
24:08
almost 2 years ago

Dapr in Practice

marcklefter

Minimising the Carbon Footprint of Workloads thumbnail
27:46
almost 2 years ago

Minimising the Carbon Footprint of Workloads

Michael Mueller

Upcoming sessions on this topic

Open session

World Congress 2026 North America

Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases

Wei Hu

Senior Vice President of Research and Development

Wei Hu
Open session

World Congress 2026 North America

Boring Failover: Predictable Region Recovery Across 5,000 Microservices

Garvit Kataria, Sahil Sabharwal

Garvit Kataria
Sahil Sabharwal
Open session

World Congress 2026 North America

Databases in the Agent Era

Monica Sarbu

Founder and CEO of xata.io

Monica Sarbu
Open session

World Congress 2026 North America

Testing React Backends Like a Pro: Mocking Databases with SQLite

David Morris

Solution Architect

David Morris
Open session

World Congress 2026 North America

Beyond SQL Generation: How to Teach Agents What Your Database Actually Means

Kris Jenkins

Lead Developer Advocate at Snowflake

Kris Jenkins
Open session

World Congress 2026 North America

You Can’t Re-Run Sunlight: Designing ML Data Architectures for Physical AI

An Phan

Senior Data Infrastructure Engineer @ Hippo Harvest

An Phan

Related videos

Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases thumbnail
28:41
WWC 2025 • 12 months ago

Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases

Wei Hu

Scaling Databases thumbnail
21:09
WWC 2024 • almost 2 years ago

Scaling Databases

Tobias Petry

TiDB, One Layer at a Time: How Distributed SQL Became an Agentic AI Backbone thumbnail
27:27
WWC Europe 2026 • about 1 month ago

TiDB, One Layer at a Time: How Distributed SQL Became an Agentic AI Backbone

Daniël van Eeden, Mattias Jonsson

Leveraging Real time data in FSIs thumbnail
41:51
LIVE • over 2 years ago

Leveraging Real time data in FSIs

Tim Faulkes

How building an industry DBMS differs from building a research one thumbnail
30:34
WWC 2023 • almost 3 years ago

How building an industry DBMS differs from building a research one

Markus Dreseler

Distributed search under the hood thumbnail
46:58
LIVE • almost 5 years ago

Distributed search under the hood

Alexander Reelsen

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.