WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
WeAreDevelopers LIVE • Apr 18, 2023

Event Messaging and Streaming with Apache Pulsar

Mary Grygleski

Does your streaming architecture suffer from scaling bottlenecks? Learn how Apache Pulsar's separation of compute and storage enables robust, low-latency event messaging at global scale.

Pause
Mute Enter Fullscreen
#1 about 5 min

Introducing data management and the shift to streaming

Reviewing background experience with scalable databases and defining the agenda for distributed event processing.

#2 about 4 min

Understanding data in motion and foundational messaging concepts

Recognizing how continuous event streaming represents changing data states sequentially across space and time.

#3 about 5 min

Clarifying terminology around different event computing software forms

Distinguishing between complex architectures like event sourcing, event-driven design, and localized reactive systems.

#4 about 4 min

Defining complex event processing and actionable continuous streams

Analyzing data series to identify real-time patterns for targeted operations like fraud detection.

#5 about 5 min

Comparing pub-sub architectures with message queuing point delivery

Analyzing differences between topic-based message broadcasting and queue-based direct consumption for system services.

#6 about 5 min

Recognizing architectural drivers pushing event streaming system adoption

Highlighting the need for real-time memory processing and immediate data ingestion over traditional batch loads.

#7 about 7 min

Evaluating cloud-native fundamentals within the pulsar open ecosystem

Unpacking the decoupled compute and storage framework supporting massive scale and automated multi-tenant workloads.

#8 about 4 min

Diving into tiered storage operations and horizontal scaling

Leveraging distinct stateless brokers and localized log managers to spread network loads evenly.

#9 about 4 min

Highlighting core enterprise differentiators and adaptable subscription parameters

Supporting active geo-replication constraints and configuring explicit consumption models tailored to multi-tenant environments.

#10 about 4 min

Transforming data pipelines natively through lightweight serverless functions

Enriching raw data dynamically using integrated schema registries and versatile input-output platform connectors.

#11 about 4 min

Managing cloud clusters and validating provisioned streaming endpoints

Creating designated database environments and verifying active pipeline connections through a centralized graphical framework.

#12 about 11 min

Securing topic access and prioritizing inclusive community involvement

Discussing localized token authentication practices and outlining the advantages of contributing actively to software communities.

Matching moments

1:11 min

Comparing cloud-based message broker and event stream solutions

Clemens Vasters Clemens Vasters · WWC 2022

2:00 min

Moving from traditional databases to decoupled event streaming

Gerard Klijs · LIVE

3:06 min

Core concepts of Apache Kafka and topic topologies

Denis Washington +1 · WWC 2021

49 sec

Processing asynchronous event streams via standard messaging patterns

Patrick Koss Patrick Koss · WWC 2024

2:13 min

Modernizing legacy applications for real-time streaming data consumption

Farooq Sheikh Farooq Sheikh +3 · WWC 2025

57 sec

Overview of the Kusto big data analytics platform

Prof Smoke Prof Smoke · WWC 2025

More from WeAreDevelopers LIVE

Aliens in Quarantine, Python Deprecates Loops, and AI Buys Old Books - Zbyszek Tenerowicz thumbnail
5:43
5 days ago

Aliens in Quarantine, Python Deprecates Loops, and AI Buys Old Books - Zbyszek Tenerowicz

Chris Heilmann, Daniel Cranney

WeAreDevelopers LIVE - Node and Package Security thumbnail
1:08:30
5 days ago

WeAreDevelopers LIVE - Node and Package Security

Chris Heilmann, Daniel Cranney, Zbyszek Tenerowicz

WeAreDevelopers LIVE - Streaming HTML thumbnail
1:10:26
12 days ago

WeAreDevelopers LIVE - Streaming HTML

Chris Heilmann, Daniel Cranney, Jad Joubran

WeAreDevelopers LIVE - CODE100 at WeAreDevelopers Europe thumbnail
1:02:34
19 days ago

WeAreDevelopers LIVE - CODE100 at WeAreDevelopers Europe

Chris Heilmann, Daniel Cranney, Justin Halsall, Werner Jeschko, Nicole Jeschko, Mirco Tomić

WeAreDevelopers LIVE - Web Performance in an AI World thumbnail
1:07:59
26 days ago

WeAreDevelopers LIVE - Web Performance in an AI World

Chris Heilmann, Daniel Cranney

FIFA Hack, Midjourney Does Ultrasounds, and Trampoline Traffic Lights - Nicole Jeschko and Werner Jeschko thumbnail
5:55
about 2 months ago

FIFA Hack, Midjourney Does Ultrasounds, and Trampoline Traffic Lights - Nicole Jeschko and Werner Jeschko

Chris Heilmann, Daniel Cranney

Upcoming sessions on this topic

Open session

World Congress 2026 North America

AI Agents are Only as Smart as their Context: Building a Real-Time Context Engine at Intuit

Bharat Patel

Lead Software Engineer at Intuit

Bharat Patel
Open session

World Congress 2026 North America

From Guesswork to Governance: Data Contracts Bring API Discipline to Apache Kafka

Sandon Jacobs

Senior Developer Advocate at IBM

Sandon Jacobs
Open session

World Congress 2026 North America

Bluesky's Open Source Moderation Tools: LLM-based Event Detection in Python

Alex Garnett

Developer Relations, Bluesky

Alex Garnett
Open session

World Congress 2026 North America

The $0.15/month Algo-Trader: Architecting High-Performance Serverless Trading Engines

Vishwak Thatikonda

Lead Full Stack Engineer at SDH Systems

Vishwak Thatikonda
Open session

World Congress 2026 North America

Agentic Drift: keeping pace with your agents

John Coghlan

Senior Director, Developer Advocacy at GitLab

John Coghlan
Open session

World Congress 2026 North America

Trust, But Verify: Continuous GPU Validation at Scale

Kyle Bell

VP of AI @ TensorWave

Kyle Bell

Related videos

Why and when should we consider Stream Processing frameworks in our solutions thumbnail
30:51
WWC 2024 • almost 2 years ago

Why and when should we consider Stream Processing frameworks in our solutions

Soroosh Khodami

Kafka Streams Microservices thumbnail
45:48
WWC 2021 • about 5 years ago

Kafka Streams Microservices

Denis Washington, Olli Salonen

Let's Get Started With Apache Kafka® for Python Developers thumbnail
38:50
LIVE • over 3 years ago

Let's Get Started With Apache Kafka® for Python Developers

Lucia Cerchie

From event streaming to event sourcing 101 thumbnail
27:33
LIVE • over 5 years ago

From event streaming to event sourcing 101

Gerard Klijs

Implementing an Event Sourcing strategy on Azure thumbnail
32:03
WWC 2023 • almost 3 years ago

Implementing an Event Sourcing strategy on Azure

Eldert Grootenboer, Olena Borzenko-Turianska

Python-Based Data Streaming Pipelines Within Minutes thumbnail
39:04
LIVE • almost 2 years ago

Python-Based Data Streaming Pipelines Within Minutes

Bobur Umurzokov

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.