> Markdown version of [/videos/100478-real-time-data-platforms-at-trillion-event-scale?t=949](https://www.wearedevelopers.com/videos/100478-real-time-data-platforms-at-trillion-event-scale?t=949). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Real-Time Data Platforms at Trillion-Event Scale

Adding just 100 microseconds to a task can inflate cloud bills by millions. Learn to architect real-time data platforms that survive trillion-event scales through extreme computational efficiency.

- **Speakers:** [Diptamay Sanyal](https://www.wearedevelopers.com/@diptamay-sanyal)
- **Event:** World Congress 2026 North America
- **Published:** September 24, 2026
- **Duration:** 26:39
- **URL:** https://www.wearedevelopers.com/videos/100478-real-time-data-platforms-at-trillion-event-scale

## Access

Playback and chapters for this video are available with a Free account.

## Related Moments

- [Introducing data management and the shift to streaming](https://www.wearedevelopers.com/videos/538-event-messaging-and-streaming-with-apache-pulsar) (from "Event Messaging and Streaming with Apache Pulsar")
- [Recognizing architectural drivers pushing event streaming system adoption](https://www.wearedevelopers.com/videos/538-event-messaging-and-streaming-with-apache-pulsar) (from "Event Messaging and Streaming with Apache Pulsar")
- [Overcoming challenges in production data stream operations](https://www.wearedevelopers.com/videos/100385-ai-agents-are-only-as-smart-as-their-context-building-a-real-time-context-engine) (from "AI Agents are Only as Smart as their Context: Building a Real-Time Context Engine")
- [Modernizing legacy applications for real-time streaming data consumption](https://www.wearedevelopers.com/videos/1367-unlocking-value-from-data-the-key-to-smarter-business-decisions) (from "Unlocking Value from Data: The Key to Smarter Business Decisions-")
- [Evaluating mature stream processing frameworks for production systems](https://www.wearedevelopers.com/videos/1085-why-and-when-should-we-consider-stream-processing-frameworks-in-our-solutions) (from "Why and when should we consider Stream Processing frameworks in our solutions")
- [Overcoming typical barriers to real-time stream processing adoption](https://www.wearedevelopers.com/videos/1233-python-based-data-streaming-pipelines-within-minutes) (from "Python-Based Data Streaming Pipelines Within Minutes")

## Related Articles

- [Why Event-Driven Architecture Isn’t About Speed (and When You Actually Need It)](https://www.wearedevelopers.com/magazine/745-why-event-driven-architecture-isn-t-about-speed-and-when-you-actually-need-it)
- [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Dev Digest 132 - Binging WADFlix?](https://www.wearedevelopers.com/magazine/473-dev-digest-132-binging-wadflix)

## Related Jobs

- [Lead Software Engineer - Data Engineering](https://www.wearedevelopers.com/jobs/ext/2000968-lead-software-engineer-data-engineering) at **Dynatrace**
- [Lead Telemetry Pipeline Specialist](https://www.wearedevelopers.com/jobs/48431-lead-telemetry-pipeline-specialist) at **Dynatrace**
- [GPU Cluster Engineer, Networking](https://www.wearedevelopers.com/jobs/48410-gpu-cluster-engineer-networking) at **Sciforium**
- [Senior AI Serving Engineer, Backend](https://www.wearedevelopers.com/jobs/48414-senior-ai-serving-engineer-backend) at **Sciforium**
- [GPU Cluster Engineer, Systems & Platform](https://www.wearedevelopers.com/jobs/48411-gpu-cluster-engineer-systems-platform) at **Sciforium**
- [Principal Software Engineer, AI Compute Platform](https://www.wearedevelopers.com/jobs/ext/2847710-principal-software-engineer-ai-compute-platform) at **ARM**