WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2024 • Aug 20, 2024 • Session details

Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases

Wei Hu

Can your database survive a 'Taylor Swift' traffic spike without sacrificing strong consistency? Discover how distributed SQL resolves extreme data skew and ensures zero-data-loss failovers at internet scale.

Pause
Mute Enter Fullscreen
#1 about 2 min

Evolution of distributed SQL database architectures

The transition from simple key-value systems to scalable databases providing strong consistency and standard SQL capabilities.

#2 about 3 min

Core mechanics of distributed database sharding

How partitioned data across physical locations remains entirely hidden from connecting applications.

#3 about 2 min

Primary use cases for widespread geographical data

Driving massive workload survivability and enforcing regional compliance through strict data sovereignty configurations.

#4 about 2 min

Managing a unified logical database entity

Dividing data into individual actively processing shards that map seamlessly to one system.

#5 about 2 min

Query routing and cross-shard parallel execution

Directing queries accurately to specific partitions or parallelizing commands across all remote instances.

#6 about 4 min

Clustered databases versus native distributed databases

Contrasting tightly-coupled single data center clusters using microsecond networking against independently spaced remote nodes.

#7 about 3 min

Mitigating physical latency with targeted geographical subsets

Overcoming baseline networking constraints by keeping operational data close to the regional consumer.

#8 about 5 min

Meeting banking legal requirements using localized sharding

Fulfilling strict regional data laws without rewriting legacy applications via transparent physical isolation.

#9 about 2 min

Sustaining extreme parallel throughput for internet services

Accelerating hyperscale digital activity targeting sub-millisecond response quotas safely via horizontal resource spreading.

#10 about 2 min

Engineering scale-out architectures specifically for relational queries

Avoiding typical degradation by constructing full relational processing directly over the core rather than mapping abstractions onto object stores.

#11 about 3 min

Configuring dynamic range and consistent hash boundaries

Maximizing index efficiency using specific hash implementations, list variables, and multiple layers of sharding categorization.

#12 about 2 min

Isolating skewed variables using directory-based routing

Segregating highly-requested records to specialized environments separating unbalanced noise from uniform performance paths.

#13 about 1 min

Minimizing geographical latency using active duplicate replication

Copying static reference tables onto every remote shard directly removing massive quantities of cross-environment joins.

#14 about 2 min

Maintaining continuous availability during transient network stalls

Establishing robust connection protocols leveraging specific consensus mathematics minimizing total runtime impact during sudden component losses.

#15 about 4 min

Reducing systemic complexity with universal converged databases

Managing varied structures like spatial geometries concurrently within a single deployment rather than fracturing operations across specialized toolchains.

Matching moments

1:52 min

Evolution of distributed SQL database management systems

Akmal Chaudhri Akmal Chaudhri · LIVE

2:12 min

Architectural benefits of single logical database topologies

Wei Hu Wei Hu · World Congress 2025

1:36 min

Evolution from key-value stores to distributed SQL

Wei Hu Wei Hu · World Congress 2025

1:55 min

Evaluating criteria for distributed SQL system adoption

Wei Hu Wei Hu · World Congress 2025

2:25 min

Distributed SQL properties for agentic AI applications

Daniël van Eeden Daniël van Eeden +1 · World Congress 2026 Europe

52 sec

Defining the core mechanics of distributed databases

Wei Hu Wei Hu · World Congress 2025

More from World Congress 2024

Beyond the Hype: Real-World AI Strategies Panel thumbnail
24:07
12 months ago

Beyond the Hype: Real-World AI Strategies Panel

Mike Butcher, Jürgen Müller, Katrin Lehmann, Tobias Regenfuss

Carl Lapierre - Exploring Advanced Patterns in Retrieval-Augmented Generation thumbnail
21:17
almost 2 years ago

Carl Lapierre - Exploring Advanced Patterns in Retrieval-Augmented Generation

Carl Lapierre

Coding an Immersive Copilot using Unity / .NET and Azure OpenAI! thumbnail
31:50
about 2 years ago

Coding an Immersive Copilot using Unity / .NET and Azure OpenAI!

Zaid Zaim

Building a diverse tech company: The power of Diversity, Equity, Inclusion, and Belonging thumbnail
29:43
about 2 years ago

Building a diverse tech company: The power of Diversity, Equity, Inclusion, and Belonging

Sue Quackenbush

Dapr in Practice thumbnail
24:08
about 2 years ago

Dapr in Practice

marcklefter

Minimising the Carbon Footprint of Workloads thumbnail
27:46
about 2 years ago

Minimising the Carbon Footprint of Workloads

Michael Mueller

Related videos

Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases thumbnail
28:41
World Congress 2025 • about 1 year ago

Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases

Wei Hu

Scaling Databases thumbnail
21:09
World Congress 2024 • about 2 years ago

Scaling Databases

Tobias Petry

TiDB, One Layer at a Time: How Distributed SQL Became an Agentic AI Backbone thumbnail
27:27
World Congress 2026 Europe • 3 months ago

TiDB, One Layer at a Time: How Distributed SQL Became an Agentic AI Backbone

Daniël van Eeden, Mattias Jonsson

Leveraging Real time data in FSIs thumbnail
41:51
LIVE • almost 3 years ago

Leveraging Real time data in FSIs

Tim Faulkes

How building an industry DBMS differs from building a research one thumbnail
30:34
World Congress 2023 • almost 3 years ago

How building an industry DBMS differs from building a research one

Markus Dreseler

Distributed search under the hood thumbnail
46:58
LIVE • almost 5 years ago

Distributed search under the hood

Alexander Reelsen

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.