> Markdown version of [/events/world-congress-2026-north-america/sessions/1899-real-time-data](https://www.wearedevelopers.com/events/world-congress-2026-north-america/sessions/1899-real-time-data). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Real-Time Data Platforms at Trillion-Event Scale


- **Date:** Thursday, Sep 24, 2026
- **Time:** 14:10–14:40 (30 min)
- **Room:** Stage 3
- **Event:** World Congress 2026 North America

## Description

Some of the largest real-time platforms in production today operate at scales that were considered theoretical a decade ago. CrowdStrike has publicly disclosed that its Falcon Threat Graph processes more than a trillion events per day across 15-plus petabytes of data, with engineering blogs describing 40-plus petabytes stored and 70 million requests per second served. Numbers like these are not unique to security — AI agent platforms, observability backends, and large SaaS analytics systems are pushing into the same territory. The interesting question is not the headline figure. It is what actually breaks at that scale, and which architectural choices keep the system honest.
This talk distills patterns and failure modes from years of building streaming and AI data platform infrastructure, framed against publicly disclosed industry references rather than any single employer's internals. Topics include:
- Stateful streaming joins across diifferent data streams
- Handling replay storms and out-of-order events without latency collapse
- The honest tradeoffs between latency, cost, and correctness — and when each one wins
- Observability and degradation modes that keep the platform usable when something is failing

Attendees will leave with concrete guidance on designing real-time systems that fail loudly, recover predictably, and surface the metrics that actually matter at scale.

Note: Views are my own and do not represent any employer. Examples reference publicly disclosed sources.

## Speaker

### [Diptamay Sanyal](https://www.wearedevelopers.com/@diptamay-sanyal)

Principal Engineer | Data, AI & Cybersecurity Platforms | IEEE Senior Member | Forbes Technology Council


## Related talks at this congress

- [Replay-Safe Architecture: Building Event-Driven Systems That Can Recover With Confidence](https://www.wearedevelopers.com/events/world-congress-2026-north-america/sessions/1754-replay-safe) — Ishan Shah
- [The Geometry of Incidents: What User-Impact Shapes Reveal About Platform Architecture](https://www.wearedevelopers.com/events/world-congress-2026-north-america/sessions/1722-the-geometry-of) — Bala Subrahmanyam Kambala
- [You Can’t Re-Run Sunlight: Designing ML Data Architectures for Physical AI](https://www.wearedevelopers.com/events/world-congress-2026-north-america/sessions/1677-you-can-t-re-run) — An Phan
- [Designing High-Performance AI APIs: Lessons from Serving Millions of Real-Time Requests](https://www.wearedevelopers.com/events/world-congress-2026-north-america/sessions/1846-designing-high) — Wayne Liu

## Watch remotely

Can’t make it to San José? Watch this session live with Pro. You also get:

- All full videos, bookmarks, and playlists
- World Congress livestreams

[See pricing](https://www.wearedevelopers.com/pricing)

## Links

- [Get tickets](https://www.wearedevelopers.com/world-congress-north-america/tickets)