WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
WeAreDevelopers LIVE • Apr 18, 2023

Event Messaging and Streaming with Apache Pulsar

Mary Grygleski

Does your streaming architecture suffer from scaling bottlenecks? Learn how Apache Pulsar's separation of compute and storage enables robust, low-latency event messaging at global scale.

Pause
Mute Enter Fullscreen
#1 about 5 min

Introducing data management and the shift to streaming

Reviewing background experience with scalable databases and defining the agenda for distributed event processing.

#2 about 4 min

Understanding data in motion and foundational messaging concepts

Recognizing how continuous event streaming represents changing data states sequentially across space and time.

#3 about 5 min

Clarifying terminology around different event computing software forms

Distinguishing between complex architectures like event sourcing, event-driven design, and localized reactive systems.

#4 about 4 min

Defining complex event processing and actionable continuous streams

Analyzing data series to identify real-time patterns for targeted operations like fraud detection.

#5 about 5 min

Comparing pub-sub architectures with message queuing point delivery

Analyzing differences between topic-based message broadcasting and queue-based direct consumption for system services.

#6 about 5 min

Recognizing architectural drivers pushing event streaming system adoption

Highlighting the need for real-time memory processing and immediate data ingestion over traditional batch loads.

#7 about 7 min

Evaluating cloud-native fundamentals within the pulsar open ecosystem

Unpacking the decoupled compute and storage framework supporting massive scale and automated multi-tenant workloads.

#8 about 4 min

Diving into tiered storage operations and horizontal scaling

Leveraging distinct stateless brokers and localized log managers to spread network loads evenly.

#9 about 4 min

Highlighting core enterprise differentiators and adaptable subscription parameters

Supporting active geo-replication constraints and configuring explicit consumption models tailored to multi-tenant environments.

#10 about 4 min

Transforming data pipelines natively through lightweight serverless functions

Enriching raw data dynamically using integrated schema registries and versatile input-output platform connectors.

#11 about 4 min

Managing cloud clusters and validating provisioned streaming endpoints

Creating designated database environments and verifying active pipeline connections through a centralized graphical framework.

#12 about 11 min

Securing topic access and prioritizing inclusive community involvement

Discussing localized token authentication practices and outlining the advantages of contributing actively to software communities.

Matching moments

1:11 min

Comparing cloud-based message broker and event stream solutions

Clemens Vasters Clemens Vasters · World Congress 2022

2:00 min

Moving from traditional databases to decoupled event streaming

Gerard Klijs · LIVE

3:06 min

Core concepts of Apache Kafka and topic topologies

Denis Washington +1 · World Congress 2021

49 sec

Processing asynchronous event streams via standard messaging patterns

Patrick Koss Patrick Koss · World Congress 2024

2:13 min

Modernizing legacy applications for real-time streaming data consumption

Farooq Sheikh Farooq Sheikh +3 · World Congress 2025

57 sec

Overview of the Kusto big data analytics platform

Prof Smoke Prof Smoke · World Congress 2025

More from WeAreDevelopers LIVE

Fake or News - AI Music Detectors, Translating Ancient Languages & Tiny Heads in Teslas - Eddie Jaoude thumbnail
6:16
5 days ago

Fake or News - AI Music Detectors, Translating Ancient Languages & Tiny Heads in Teslas - Eddie Jaoude

Chris Heilmann, Daniel Cranney

Fake or News: AI Agents Hire Each Other, Spider-Man Ads in Cars & RAM Thieves - Marc Plogas thumbnail
5:46
10 days ago

Fake or News: AI Agents Hire Each Other, Spider-Man Ads in Cars & RAM Thieves - Marc Plogas

Chris Heilmann, Daniel Cranney, Marc Plogas

WeAreDevelopers - Of Agents and Robots thumbnail
1:04:42
10 days ago

WeAreDevelopers - Of Agents and Robots

Chris Heilmann, Daniel Cranney, Marc Plogas

WeAreDevelopers LIVE - How DevRel Makes Tech More Human thumbnail
48:06
17 days ago

WeAreDevelopers LIVE - How DevRel Makes Tech More Human

Chris Heilmann, Daniel Cranney

Fake or News: Smart Glasses in Court, Medical Advice Watches & Mushroom Electonics - Jason Torres thumbnail
7:41
18 days ago

Fake or News: Smart Glasses in Court, Medical Advice Watches & Mushroom Electonics - Jason Torres

Chris Heilmann, Daniel Cranney

Aliens in Quarantine, Python Deprecates Loops, and AI Buys Old Books - Zbyszek Tenerowicz thumbnail
5:43
about 1 month ago

Aliens in Quarantine, Python Deprecates Loops, and AI Buys Old Books - Zbyszek Tenerowicz

Chris Heilmann, Daniel Cranney

Upcoming sessions on this topic

Open session

World Congress 2026 North America

September 24, 2026 · 14:10–14:40

Stage 3

Real-Time Data Platforms at Trillion-Event Scale

Diptamay Sanyal

Principal Engineer | Data, AI & Cybersecurity Platforms

Diptamay Sanyal
Open session

World Congress 2026 North America

September 24, 2026 · 17:30–18:00

Stage 3

Scaling Distributed Queues for AI workloads

Jasmit Kaur Saluja

Software Engineer at Meta Platforms Inc

Jasmit Kaur Saluja
Open session

World Congress 2026 North America

September 25, 2026 · 12:55–13:25

Stage 3

Replay-Safe Architecture: Building Event-Driven Systems That Can Recover With Confidence

Ishan Shah

PayPal, Software Engineer | Distributed Systems, AI, and Platform Engineering

Ishan Shah
Open session

World Congress 2026 North America

September 25, 2026 · 09:00–09:30

Stage 7

AI Agents are Only as Smart as their Context: Building a Real-Time Context Engine at Intuit

Bharat Patel

Lead Software Engineer at Intuit

Bharat Patel
Open session

World Congress 2026 North America

September 24, 2026 · 16:50–17:20

Stage 9

From Guesswork to Governance: Data Contracts Bring API Discipline to Apache Kafka

Sandon Jacobs

Senior Developer Advocate at IBM

Sandon Jacobs
Open session

World Congress 2026 North America

September 25, 2026 · 13:30–14:00

Stage 2

Bluesky's Open Source Moderation Tools: LLM-based Event Detection in Python

Alex Garnett

Developer Relations, Bluesky

Alex Garnett

Related videos

Why and when should we consider Stream Processing frameworks in our solutions thumbnail
30:51
World Congress 2024 • about 2 years ago

Why and when should we consider Stream Processing frameworks in our solutions

Soroosh Khodami

Kafka Streams Microservices thumbnail
45:48
World Congress 2021 • about 5 years ago

Kafka Streams Microservices

Denis Washington, Olli Salonen

Let's Get Started With Apache Kafka® for Python Developers thumbnail
38:50
LIVE • over 3 years ago

Let's Get Started With Apache Kafka® for Python Developers

Lucia Cerchie

From event streaming to event sourcing 101 thumbnail
27:33
LIVE • almost 6 years ago

From event streaming to event sourcing 101

Gerard Klijs

Implementing an Event Sourcing strategy on Azure thumbnail
32:03
World Congress 2023 • almost 3 years ago

Implementing an Event Sourcing strategy on Azure

Eldert Grootenboer, Olena Borzenko-Turianska

Python-Based Data Streaming Pipelines Within Minutes thumbnail
39:04
LIVE • almost 2 years ago

Python-Based Data Streaming Pipelines Within Minutes

Bobur Umurzokov

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.