WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2022 β€’ Jun 15, 2022

What is a Message Queue and when and why would I use it?

Clemens Vasters

Is synchronous communication breaking your application under heavy load? Stop relying on fragile RPC architectures. Learn how true message queues enable robust, self-healing distributed systems.

Pause
Mute Enter Fullscreen
#1 about 6 min

Asynchronous communication history and real-world queueing examples

How historical postal systems and physical lines illustrate the scalability of asynchronous messaging.

#2 about 7 min

Hidden queues in CPU thread scheduling and execution

How operating systems use job, ready, and I/O queues to manage constrained compute resources.

#3 about 4 min

Queues in TCP stacks and continuous network connections

How operating systems utilize accept queues and input buffers to manage incoming network requests.

#4 about 2 min

The illusion of synchronous APIs and explicit message queues

Why relying solely on remote procedure calls obscures internal queuing and leads to overloaded applications.

#5 about 6 min

Fundamental data structure traits of a software queue

Why queues are dynamic, right-only/read-only structures that allow observing length and managing capacity.

#6 about 4 min

Defining message queues and message lifecycle management

How message brokers safely accept, store, and exclusively assign messages to prevent data loss.

#7 about 2 min

Distinguishing message queues from Apache Kafka event streams

Why Kafka functions as an event stream rather than a traditional queue due to lacking individual message lifecycle management.

#8 about 3 min

Anatomy of a message envelope and associated metadata

How payloads remain independent while metadata directs transport routing and quality of service.

#9 about 3 min

Implementing basic send and receive interactions in code

How reactive frameworks process queued data using simplified sender, receiver, and scaling operations.

#10 about 5 min

Reliability of message queues in finance and remote automation

How transactional queue movement ensures data integrity for ATMs, industrial automation, and connected vehicles.

#11 about 2 min

Using queues for highly secure network segmentation bridges

How pull mechanisms allow safe layer seven communication between isolated virtual networks.

#12 about 3 min

Competing consumers and load leveling for burst traffic

How multiple consumers safely handle traffic spikes by exclusively processing individual queue messages.

#13 about 4 min

Advanced message queue features and error handling mechanisms

How sequences, time-to-live settings, dead letter queues, and transactions handle complex messaging scenarios.

#14 about 2 min

Comparing cloud-based message broker and event stream solutions

How cloud products align with queuing, generic publish/subscribe, or discrete event streaming models.

#15 about 1 min

Handling large data blobs using the claim check pattern

Why passing storage links rather than full files optimizes message queue infrastructure efficiency.

Matching moments

1:48 min

Managing asynchronous communications and load leveling

PaweΕ‚ Siwek PaweΕ‚ Siwek Β· World Congress 2025

49 sec

Managing intent-based workloads using message queues

Eldert Grootenboer +1 Β· World Congress 2023

49 sec

Processing asynchronous event streams via standard messaging patterns

Patrick Koss Patrick Koss Β· World Congress 2024

4:44 min

Comparing pub-sub architectures with message queuing point delivery

Mary Grygleski Mary Grygleski Β· LIVE

1:59 min

Decoupling microservices with asynchronous messaging queues

David Leitner Β· World Congress 2022

2:24 min

Decoupling synchronous system dependencies using asynchronous message queues

Violetta Pidvolotska Violetta Pidvolotska Β· Europe 2026 Virtual

More from World Congress 2022

What the heck do "declarative" and "reactive" actually mean? thumbnail
30:40
about 4 years ago

What the heck do "declarative" and "reactive" actually mean?

AndrΓ© Kovac

The Design and Evolution of C++ thumbnail
1:01:15
about 4 years ago

The Design and Evolution of C++

Bjarne Stroustrup

But, you're not Facebook thumbnail
31:12
about 4 years ago

But, you're not Facebook

Kristijan Ristovski

Communicate efficiently with Software Architecture Diagrams thumbnail
28:11
about 4 years ago

Communicate efficiently with Software Architecture Diagrams

Simon Lasselsberger

Get Ready for Jakarta EE 10! thumbnail
42:53
about 4 years ago

Get Ready for Jakarta EE 10!

Ivar Grimstad

Keep your code refactorable thumbnail
26:46
about 4 years ago

Keep your code refactorable

Gerrit Stapper

Upcoming sessions on this topic

Open session

World Congress 2026 North America

September 24, 2026 Β· 17:30–18:00

Stage 3

Scaling Distributed Queues for AI workloads

Jasmit Kaur Saluja

Software Engineer at Meta Platforms Inc

Jasmit Kaur Saluja
Open session

World Congress 2026 North America

September 25, 2026 Β· 12:55–13:25

Stage 3

Replay-Safe Architecture: Building Event-Driven Systems That Can Recover With Confidence

Ishan Shah

PayPal, Software Engineer | Distributed Systems, AI, and Platform Engineering

Ishan Shah
Open session

World Congress 2026 North America

September 24, 2026 Β· 16:50–17:20

Stage 9

From Guesswork to Governance: Data Contracts Bring API Discipline to Apache Kafka

Sandon Jacobs

Senior Developer Advocate at IBM

Sandon Jacobs
Open session

World Congress 2026 North America

September 25, 2026 Β· 09:00–09:30

Stage 3

Your Thread Pool Is Lying to You β€” Sizing Concurrency from Rate Limits and Latency, Not Guesswork

Ratul Ghosh, Sesha Chennupati

Ratul Ghosh
Sesha Chennupati
Open session

World Congress 2026 North America

September 24, 2026 Β· 14:10–14:40

Stage 3

Real-Time Data Platforms at Trillion-Event Scale

Diptamay Sanyal

Principal Engineer | Data, AI & Cybersecurity Platforms

Diptamay Sanyal
Open session

World Congress 2026 North America

September 24, 2026 Β· 17:30–18:00

Stage 6

No Single Model to Rule Them All: Building Resilient AI Agents Across Open & Closed LLMs

Emmanuel Acheampong

Senior Manager Developer Relations at Crusoe AI

Emmanuel Acheampong

Related videos

The Lifehacker's Guide to Software Architecture thumbnail
25:40
World Congress 2024 β€’ about 2 years ago

The Lifehacker's Guide to Software Architecture

Julian Lang

Event Messaging and Streaming with Apache Pulsar thumbnail
57:19
LIVE β€’ over 3 years ago

Event Messaging and Streaming with Apache Pulsar

Mary Grygleski

Beyond Webhooks: The Future of Scalable API Event Delivery thumbnail
26:04
World Congress 2026 Europe β€’ about 2 months ago

Beyond Webhooks: The Future of Scalable API Event Delivery

Phil Leggetter

CQRS and Event Sourcing without the pixie dust thumbnail
43:27
World Congress 2021 β€’ about 5 years ago

CQRS and Event Sourcing without the pixie dust

Allard Buijze

The Rise of Reactive Microservices thumbnail
46:24
World Congress 2022 β€’ about 4 years ago

The Rise of Reactive Microservices

David Leitner

Development of reactive applications with Quarkus thumbnail
39:10
LIVE β€’ almost 6 years ago

Development of reactive applications with Quarkus

Niklas Heidloff

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.