WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2022 • Jun 15, 2022

What is a Message Queue and when and why would I use it?

Clemens Vasters

Is synchronous communication breaking your application under heavy load? Stop relying on fragile RPC architectures. Learn how true message queues enable robust, self-healing distributed systems.

Pause
Mute Enter Fullscreen
#1 about 6 min

Asynchronous communication history and real-world queueing examples

How historical postal systems and physical lines illustrate the scalability of asynchronous messaging.

#2 about 7 min

Hidden queues in CPU thread scheduling and execution

How operating systems use job, ready, and I/O queues to manage constrained compute resources.

#3 about 4 min

Queues in TCP stacks and continuous network connections

How operating systems utilize accept queues and input buffers to manage incoming network requests.

#4 about 2 min

The illusion of synchronous APIs and explicit message queues

Why relying solely on remote procedure calls obscures internal queuing and leads to overloaded applications.

#5 about 6 min

Fundamental data structure traits of a software queue

Why queues are dynamic, right-only/read-only structures that allow observing length and managing capacity.

#6 about 4 min

Defining message queues and message lifecycle management

How message brokers safely accept, store, and exclusively assign messages to prevent data loss.

#7 about 2 min

Distinguishing message queues from Apache Kafka event streams

Why Kafka functions as an event stream rather than a traditional queue due to lacking individual message lifecycle management.

#8 about 3 min

Anatomy of a message envelope and associated metadata

How payloads remain independent while metadata directs transport routing and quality of service.

#9 about 3 min

Implementing basic send and receive interactions in code

How reactive frameworks process queued data using simplified sender, receiver, and scaling operations.

#10 about 5 min

Reliability of message queues in finance and remote automation

How transactional queue movement ensures data integrity for ATMs, industrial automation, and connected vehicles.

#11 about 2 min

Using queues for highly secure network segmentation bridges

How pull mechanisms allow safe layer seven communication between isolated virtual networks.

#12 about 3 min

Competing consumers and load leveling for burst traffic

How multiple consumers safely handle traffic spikes by exclusively processing individual queue messages.

#13 about 4 min

Advanced message queue features and error handling mechanisms

How sequences, time-to-live settings, dead letter queues, and transactions handle complex messaging scenarios.

#14 about 2 min

Comparing cloud-based message broker and event stream solutions

How cloud products align with queuing, generic publish/subscribe, or discrete event streaming models.

#15 about 1 min

Handling large data blobs using the claim check pattern

Why passing storage links rather than full files optimizes message queue infrastructure efficiency.

Matching moments

1:48 min

Managing asynchronous communications and load leveling

Paweł Siwek Paweł Siwek · WWC 2025

49 sec

Managing intent-based workloads using message queues

Eldert Grootenboer +1 · WWC 2023

49 sec

Processing asynchronous event streams via standard messaging patterns

Patrick Koss Patrick Koss · WWC 2024

4:44 min

Comparing pub-sub architectures with message queuing point delivery

Mary Grygleski Mary Grygleski · LIVE

1:59 min

Decoupling microservices with asynchronous messaging queues

David Leitner · WWC 2022

3:16 min

Isolating latency logic inside event queues

David Leitner · LIVE

More from World Congress 2022

What the heck do "declarative" and "reactive" actually mean? thumbnail
30:40
almost 4 years ago

What the heck do "declarative" and "reactive" actually mean?

André Kovac

The Design and Evolution of C++ thumbnail
1:01:15
about 4 years ago

The Design and Evolution of C++

Bjarne Stroustrup

But, you're not Facebook thumbnail
31:12
about 4 years ago

But, you're not Facebook

Kristijan Ristovski

Communicate efficiently with Software Architecture Diagrams thumbnail
28:11
about 4 years ago

Communicate efficiently with Software Architecture Diagrams

Simon Lasselsberger

Get Ready for Jakarta EE 10! thumbnail
42:53
about 4 years ago

Get Ready for Jakarta EE 10!

Ivar Grimstad

Keep your code refactorable thumbnail
26:46
about 4 years ago

Keep your code refactorable

Gerrit Stapper

Upcoming sessions on this topic

Open session

World Congress 2026 North America

From Guesswork to Governance: Data Contracts Bring API Discipline to Apache Kafka

Sandon Jacobs

Senior Developer Advocate at IBM

Sandon Jacobs
Open session

World Congress 2026 North America

No Single Model to Rule Them All: Building Resilient AI Agents Across Open & Closed LLMs

Emmanuel Acheampong

Senior Manager Developer Relations at Crusoe AI

Emmanuel Acheampong
Open session

World Congress 2026 North America

Designing APIs That Survive AI Agents at Scale

Phani Pendurthi

Mastercard, Principal Software Engineer

Phani Pendurthi
Open session

World Congress 2026 North America

Look What Java Can Do Now: Live-Coding a GenAI MCP Server with the JAQ Stack

Suren Konathala

Senior Engineering Leader, Marketing & AdTech, AI GTM & Digital Experience Platforms, Java x AI

Suren Konathala
Open session

World Congress 2026 North America

KV Cache Is Not About Speed: It's About Surviving Inference Costs

David vonThenen

AI/ML Leader | Keynote Speaker | OSS Engineer & Developer Advocate | Agentic AI, Deep Learning, Production AI | Python, Go, C++

David vonThenen
Open session

World Congress 2026 North America

AI Agents are Only as Smart as their Context: Building a Real-Time Context Engine at Intuit

Bharat Patel

Lead Software Engineer at Intuit

Bharat Patel

Related videos

The Lifehacker's Guide to Software Architecture thumbnail
25:40
WWC 2024 • almost 2 years ago

The Lifehacker's Guide to Software Architecture

Julian Lang

Event Messaging and Streaming with Apache Pulsar thumbnail
57:19
LIVE • over 3 years ago

Event Messaging and Streaming with Apache Pulsar

Mary Grygleski

Beyond Webhooks: The Future of Scalable API Event Delivery thumbnail
26:04
WWC Europe 2026 • about 1 month ago

Beyond Webhooks: The Future of Scalable API Event Delivery

Phil Leggetter

CQRS and Event Sourcing without the pixie dust thumbnail
43:27
WWC 2021 • about 5 years ago

CQRS and Event Sourcing without the pixie dust

Allard Buijze

The Rise of Reactive Microservices thumbnail
46:24
WWC 2022 • about 4 years ago

The Rise of Reactive Microservices

David Leitner

Development of reactive applications with Quarkus thumbnail
39:10
LIVE • over 5 years ago

Development of reactive applications with Quarkus

Niklas Heidloff

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.