WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2025 • Aug 20, 2025 • Session details

gRPC Load Balancing Deep Dive

Max Hausner , Yves Fauser

Your new pods sit idle while initial targets remain overloaded by long-lived gRPC streams. Discover how to eliminate HTTP/2 connection hotspots using advanced layer 7 load balancing.

Pause
Mute Enter Fullscreen
#1 about 2 min

Overview of gRPC and language-agnostic environments

The gRPC framework allows defining service environments and applications across multiple programming languages.

#2 about 1 min

Comparing protobuf efficiency against JSON responses

Using protobuf formats reduces byte size over the wire compared to standard JSON APIs.

#3 about 2 min

Limitations and browser support challenges in gRPC

The gRPC framework faces browser compatibility limitations and lacks the overall ecosystem maturity of traditional REST APIs.

#4 about 2 min

Different methods for making gRPC network calls

The gRPC protocol supports unary, server streaming, client streaming, and bidirectional communication modes.

#5 about 3 min

Protocol stack and HTTP/2 persistent connections

The gRPC stack relies on HTTP/2 over persistent TCP connections which complicates traditional layer 4 load balancing.

#6 about 4 min

Distinguishing client-based and infrastructure-based load balancing

Client-side balancing works well internally while infrastructure balancers provide external network demarcation points.

#7 about 3 min

Basic and load-based balancing algorithm strategies

Round robin and least outstanding request algorithms manage traffic distribution dynamically across available targets.

#8 about 5 min

Hash-based load balancing and connection stickiness

Consistent ring hashing and n-tuple hashing maintain target stickiness but risk creating heavy traffic hotspots.

#9 about 2 min

Autoscaling limitations with persistent HTTP/2 streams

Adding new pods during high CPU load fails to resolve hotspots naturally due to long-lived streaming connections.

#10 about 3 min

Functional testing and health checks for gRPC

Tools like grpcurl and layer 7 balancers decode protobuf schemas for functional API testing and automated health checks.

#11 about 2 min

Benchmarking gRPC endpoints using load testing tools

The ghz command line tool evaluates response times and performance distribution across different balancing algorithms.

#12 about 3 min

Resolving hotspots by separating streaming and unary traffic

Routing streams and unary calls through different target groups prevents severe traffic imbalances during autoscaling.

#13 about 2 min

Key considerations for gRPC load distribution

Understanding client load distribution and shortening session lengths mitigates traffic hotspots continuously.

Matching moments

1:28 min

Understanding the architectural drivers of gRPC performance gains

Sakshi Nasha Sakshi Nasha · Europe 2026 Virtual

1:13 min

Choosing between gRPC and REST for specific use cases

Sakshi Nasha Sakshi Nasha · Europe 2026 Virtual

6:34 min

Designing load-balanced cloud architectures for concurrent routing

Oliver Zimmert · LIVE

2:49 min

Handling multi-connection metrics and gRPC integration

Jan Mensch Jan Mensch · World Congress 2026 Europe

3:11 min

Evaluating communication protocols for high performance microservices

Aleksandr Kalikov · LIVE

2:41 min

High performance communication protocols using gRPC

Simon Auer Simon Auer · World Congress 2025

More from World Congress 2025

GenAI Security: Navigating the Unseen Iceberg thumbnail
24:33
11 months ago

GenAI Security: Navigating the Unseen Iceberg

Maish Saidel-Keesing

Behind the Code: How Women Are Powering the Future of AI thumbnail
30:28
about 1 year ago

Behind the Code: How Women Are Powering the Future of AI

Alexandra Wudel, Laura Moritz, Madalina Florean

The AI Hype Filter: What’s Real, What’s Investable, What’s Noise? thumbnail
28:12
about 1 year ago

The AI Hype Filter: What’s Real, What’s Investable, What’s Noise?

Justus Lumpe, Konstantin Vinogradov, Nils Eiteneyer, Stephan Wirris

AI in Leadership: How Technology is Reshaping Executive Roles thumbnail
28:19
about 1 year ago

AI in Leadership: How Technology is Reshaping Executive Roles

Bernd Datler, Jasmin Kaiser, Jeff Hausmann, Sonja Alvarez

The AI-Ready Stack: Rethinking the Engineering Org of the Future thumbnail
28:09
about 1 year ago

The AI-Ready Stack: Rethinking the Engineering Org of the Future

Alex Laubscher, Jan Oberhauser, Keno Dreßel, Mirko Novakovic

AI Sovereignty: What Does It Take? thumbnail
29:13
about 1 year ago

AI Sovereignty: What Does It Take?

Boris Hecker, Clemens Wasner, Robin Hermann, Sonja Alvarez

Related videos

Designing gRPC APIs - The things they don't tell you thumbnail
27:17
World Congress 2023 • almost 3 years ago

Designing gRPC APIs - The things they don't tell you

Bastian Eicher

Exploring the Power of gRPC-Gateway for Writing RESTful Services thumbnail
26:45
Europe 2026 Virtual • 3 months ago

Exploring the Power of gRPC-Gateway for Writing RESTful Services

Rajiv Ranjan Singh

Boosting OpenSearch Performance: gRPC Search in Action thumbnail
24:20
Europe 2026 Virtual • 3 months ago

Boosting OpenSearch Performance: gRPC Search in Action

Sakshi Nasha

Boosting OpenSearch Performance: gRPC Search in Action thumbnail
24:20
Europe 2026 Virtual • 3 months ago

Boosting OpenSearch Performance: gRPC Search in Action

Sakshi Nasha

The Great API Debate: REST, GraphQL, or gRPC? thumbnail
28:16
World Congress 2024 • about 2 years ago

The Great API Debate: REST, GraphQL, or gRPC?

Alexis Yushin

Scoring 2000 Products per Request: Performance Pitfalls in Golang thumbnail
36:10
Europe 2026 Virtual • 3 months ago

Scoring 2000 Products per Request: Performance Pitfalls in Golang

Ivan Sinitsin

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.