> Markdown version of [/videos/100478-real-time-data-platforms-at-trillion-event-scale?t=217](https://www.wearedevelopers.com/videos/100478-real-time-data-platforms-at-trillion-event-scale?t=217). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Real-Time Data Platforms at Trillion-Event Scale

Adding just 100 microseconds to a task can inflate cloud bills by millions. Learn to architect real-time data platforms that survive trillion-event scales through extreme computational efficiency.

- **Speakers:** [Diptamay Sanyal](https://www.wearedevelopers.com/@diptamay-sanyal)
- **Event:** World Congress 2026 North America
- **Published:** September 24, 2026
- **Duration:** 26:39
- **URL:** https://www.wearedevelopers.com/videos/100478-real-time-data-platforms-at-trillion-event-scale
- **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/ae7ccdd9ae67e29d676b96f6f46cfd61/thumbnails/thumbnail.jpg?time=219297ms

## Access

Playback and chapters for this video are available with a Free account.

## Related Moments

- [Introducing data management and the shift to streaming](https://www.wearedevelopers.com/videos/538-event-messaging-and-streaming-with-apache-pulsar) (from "Event Messaging and Streaming with Apache Pulsar")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/aa4d72c55bc0fa3eda9e7e8295882d73/thumbnails/thumbnail.jpg?time=277700ms
- [Recognizing architectural drivers pushing event streaming system adoption](https://www.wearedevelopers.com/videos/538-event-messaging-and-streaming-with-apache-pulsar) (from "Event Messaging and Streaming with Apache Pulsar")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/aa4d72c55bc0fa3eda9e7e8295882d73/thumbnails/thumbnail.jpg?time=277700ms
- [Overcoming challenges in production data stream operations](https://www.wearedevelopers.com/videos/100385-ai-agents-are-only-as-smart-as-their-context-building-a-real-time-context-engine) (from "AI Agents are Only as Smart as their Context: Building a Real-Time Context Engine")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/da60cc6d4ae94e00e8e2b8e87a724094/thumbnails/thumbnail.jpg?time=91961ms
- [Modernizing legacy applications for real-time streaming data consumption](https://www.wearedevelopers.com/videos/1367-unlocking-value-from-data-the-key-to-smarter-business-decisions) (from "Unlocking Value from Data: The Key to Smarter Business Decisions-")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/bea4c6fffbc7fc0df0099d1d1faf7011/thumbnails/thumbnail.jpg?time=118005ms
- [Evaluating mature stream processing frameworks for production systems](https://www.wearedevelopers.com/videos/1085-why-and-when-should-we-consider-stream-processing-frameworks-in-our-solutions) (from "Why and when should we consider Stream Processing frameworks in our solutions")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/86d0b41c0678f8ad5950ee7a45e17d00/thumbnails/thumbnail.jpg?time=112805ms
- [Overcoming typical barriers to real-time stream processing adoption](https://www.wearedevelopers.com/videos/1233-python-based-data-streaming-pipelines-within-minutes) (from "Python-Based Data Streaming Pipelines Within Minutes")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/ac9a481ba963b349fd438e61d5e9c941/thumbnails/thumbnail.jpg?time=146155ms

## Related Articles

- [Why Event-Driven Architecture Isn’t About Speed (and When You Actually Need It)](https://www.wearedevelopers.com/magazine/745-why-event-driven-architecture-isn-t-about-speed-and-when-you-actually-need-it)
- [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Your Rollback Plan is Too Slow and How to Fix It](https://www.wearedevelopers.com/magazine/794-your-rollback-plan-is-too-slow-and-how-to-fix-it)

## Related Jobs

- [Lead Software Engineer - Data Engineering](https://www.wearedevelopers.com/jobs/ext/2000968-lead-software-engineer-data-engineering) at **Dynatrace**
- [Staff Production Engineer, Database Infrastructure](https://www.wearedevelopers.com/jobs/ext/3875094-staff-production-engineer-database-infrastructure) at **GitHub**
- [Lead Telemetry Pipeline Specialist](https://www.wearedevelopers.com/jobs/48431-lead-telemetry-pipeline-specialist) at **Dynatrace**
- [Principal Software Engineer, AI Compute Platform](https://www.wearedevelopers.com/jobs/ext/3912651-principal-software-engineer-ai-compute-platform) at **ARM**
- [Software Engineer-Platform Engineering (L3)](https://www.wearedevelopers.com/jobs/ext/2599346-software-engineer-platform-engineering-l3) at **Twilio**
- [Staff Software Engineer, AI Compute Platform](https://www.wearedevelopers.com/jobs/ext/3928542-staff-software-engineer-ai-compute-platform) at **ARM**