WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2022 • Jun 15, 2022

What is a Message Queue and when and why would I use it?

Clemens Vasters

Is synchronous communication breaking your application under heavy load? Stop relying on fragile RPC architectures. Learn how true message queues enable robust, self-healing distributed systems.

Pause
Mute Enter Fullscreen
#1 about 6 min

Asynchronous communication history and real-world queueing examples

How historical postal systems and physical lines illustrate the scalability of asynchronous messaging.

#2 about 7 min

Hidden queues in CPU thread scheduling and execution

How operating systems use job, ready, and I/O queues to manage constrained compute resources.

#3 about 4 min

Queues in TCP stacks and continuous network connections

How operating systems utilize accept queues and input buffers to manage incoming network requests.

#4 about 2 min

The illusion of synchronous APIs and explicit message queues

Why relying solely on remote procedure calls obscures internal queuing and leads to overloaded applications.

#5 about 6 min

Fundamental data structure traits of a software queue

Why queues are dynamic, right-only/read-only structures that allow observing length and managing capacity.

#6 about 4 min

Defining message queues and message lifecycle management

How message brokers safely accept, store, and exclusively assign messages to prevent data loss.

#7 about 2 min

Distinguishing message queues from Apache Kafka event streams

Why Kafka functions as an event stream rather than a traditional queue due to lacking individual message lifecycle management.

#8 about 3 min

Anatomy of a message envelope and associated metadata

How payloads remain independent while metadata directs transport routing and quality of service.

#9 about 3 min

Implementing basic send and receive interactions in code

How reactive frameworks process queued data using simplified sender, receiver, and scaling operations.

#10 about 5 min

Reliability of message queues in finance and remote automation

How transactional queue movement ensures data integrity for ATMs, industrial automation, and connected vehicles.

#11 about 2 min

Using queues for highly secure network segmentation bridges

How pull mechanisms allow safe layer seven communication between isolated virtual networks.

#12 about 3 min

Competing consumers and load leveling for burst traffic

How multiple consumers safely handle traffic spikes by exclusively processing individual queue messages.

#13 about 4 min

Advanced message queue features and error handling mechanisms

How sequences, time-to-live settings, dead letter queues, and transactions handle complex messaging scenarios.

#14 about 2 min

Comparing cloud-based message broker and event stream solutions

How cloud products align with queuing, generic publish/subscribe, or discrete event streaming models.

#15 about 1 min

Handling large data blobs using the claim check pattern

Why passing storage links rather than full files optimizes message queue infrastructure efficiency.

Matching moments

1:48 min

Managing asynchronous communications and load leveling

Paweł Siwek Paweł Siwek · World Congress 2025

49 sec

Managing intent-based workloads using message queues

Eldert Grootenboer +1 · World Congress 2023

49 sec

Processing asynchronous event streams via standard messaging patterns

Patrick Koss Patrick Koss · World Congress 2024

4:44 min

Comparing pub-sub architectures with message queuing point delivery

Mary Grygleski Mary Grygleski · LIVE

1:59 min

Decoupling microservices with asynchronous messaging queues

David Leitner · World Congress 2022

2:24 min

Decoupling synchronous system dependencies using asynchronous message queues

Violetta Pidvolotska Violetta Pidvolotska · Europe 2026 Virtual

More from World Congress 2022

What the heck do "declarative" and "reactive" actually mean? thumbnail
30:40
about 4 years ago

What the heck do "declarative" and "reactive" actually mean?

André Kovac

The Design and Evolution of C++ thumbnail
1:01:15
over 4 years ago

The Design and Evolution of C++

Bjarne Stroustrup

But, you're not Facebook thumbnail
31:12
over 4 years ago

But, you're not Facebook

Kristijan Ristovski

Communicate efficiently with Software Architecture Diagrams thumbnail
28:11
over 4 years ago

Communicate efficiently with Software Architecture Diagrams

Simon Lasselsberger

Get Ready for Jakarta EE 10! thumbnail
42:53
over 4 years ago

Get Ready for Jakarta EE 10!

Ivar Grimstad

Keep your code refactorable thumbnail
26:46
over 4 years ago

Keep your code refactorable

Gerrit Stapper

Related videos

The Lifehacker's Guide to Software Architecture thumbnail
25:40
World Congress 2024 • about 2 years ago

The Lifehacker's Guide to Software Architecture

Julian Lang

Event Messaging and Streaming with Apache Pulsar thumbnail
57:19
LIVE • over 3 years ago

Event Messaging and Streaming with Apache Pulsar

Mary Grygleski

Beyond Webhooks: The Future of Scalable API Event Delivery thumbnail
26:04
World Congress 2026 Europe • 3 months ago

Beyond Webhooks: The Future of Scalable API Event Delivery

Phil Leggetter

CQRS and Event Sourcing without the pixie dust thumbnail
43:27
World Congress 2021 • about 5 years ago

CQRS and Event Sourcing without the pixie dust

Allard Buijze

The Rise of Reactive Microservices thumbnail
46:24
World Congress 2022 • over 4 years ago

The Rise of Reactive Microservices

David Leitner

Development of reactive applications with Quarkus thumbnail
39:10
LIVE • almost 6 years ago

Development of reactive applications with Quarkus

Niklas Heidloff

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.