> Markdown version of [/videos/57-all-your-telemetry-data-from-any-source-in-one-place](https://www.wearedevelopers.com/videos/57-all-your-telemetry-data-from-any-source-in-one-place). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# All your telemetry data from any source in one place

Centralize your metrics, events, logs, and traces to finally conquer tool sprawl. Discover how a unified telemetry platform transforms reactive troubleshooting into a strategic engineering asset.

- **Speakers:** Liam Hurrell
- **Event:** WeAreDevelopers LIVE
- **Published:** October 14, 2020
- **Duration:** 2:01:25
- **URL:** https://www.wearedevelopers.com/videos/57-all-your-telemetry-data-from-any-source-in-one-place

## Summary

The transition from traditional monitoring to full-stack observability is essential for managing modern, cloud-native ecosystems. As distributed systems and microservices scale, engineering teams often face tool sprawl and siloed telemetry data, complicating the troubleshooting process. Moving beyond basic metrics, dashboards, and alerts requires centralizing all data types—metrics, events, logs, and traces—into a single, scalable storage layer.

A unified Telemetry Data Platform (TDP) solves this by decoupling raw metric collection from storage and visualization. By embracing open-source standardization like OpenTelemetry, engineers can route data from existing tools directly into a centralized database. For example, utilizing the Prometheus Remote Write API allows teams to continuously ingest Kubernetes cluster metrics into a unified platform while maintaining their established Grafana dashboard configurations, effectively breaking down data silos without disrupting existing workflows.

Ultimately, this architecture enables observability-driven development, where operational metrics are directly correlated with business KPIs. Teams can leverage SQL-like languages, such as the New Relic Query Language (NRQL) or PromQL, to perform complex, rapid data querying. By coupling customized visualizations with threshold-based proactive alerts, developers transform their telemetry data from a reactive troubleshooting utility into a strategic asset for continuous system improvement.

**Keywords:** telemetry data integration, monitoring vs observability, unified telemetry platform, prometheus remote write, grafana dashboard configuration, new relic query language, cloud-native application monitoring, kubernetes cluster instrumentation, opentelemetry standardization, proactive metric alerts, full-stack observability, breaking data silos, sql-like data querying, distributed systems tracing

## Chapters

1. **Introduction to metrics and observability challenges in monitoring** (03:17) — Understanding how dimensional metrics, events, logs, and distributed traces connect to business key performance indicators across complex cloud-native systems.
1. **Consolidating observability data within a unified telemetry platform** (20:21) — Centralizing application metrics and open-source tool data into a single time-series database simplifies team troubleshooting workflows.
1. **Setting up the interactive dashboard integration lab environment** (25:55) — Preparing a web-based educational sandbox track that deploys a containerized monitoring environment using targeted helm charts.
1. **Configuring Prometheus remote write and connecting Grafana dashboards** (47:48) — Modifying configuration syntax and adding custom headers securely routes existing metric data flows to a centralized storage solution.
1. **Building flexible custom charts with SQL-style query languages** (76:21) — Crafting targeted dashboard visualizations requires aggregating specific telemetry attributes and filtering results by unique application event types.
1. **Creating automated notification policies based on custom query thresholds** (99:45) — Constructing static alert conditions against ingested traffic ensures rapid response to application performance degradations and unhandled latency spikes.
1. **Evaluating full-stack observability platforms and operational pricing models** (108:05) — Understanding free tier ingestion limitations and data management costs helps software engineering teams choose scalable observability strategies.

## Related Moments

- [Visualizing Prometheus open metrics using custom Grafana dashboards](https://www.wearedevelopers.com/videos/88-5-steps-for-running-a-kubernetes-environment-at-scale) (from "5 steps for running a Kubernetes environment at scale")
- [Exploring advanced observability stacks and distributed infrastructure challenges](https://www.wearedevelopers.com/videos/544-plan-ci-cd-on-the-enterprise-level) (from "Plan CI/CD on the Enterprise level!")
- [Deploying layered observability and synthetic monitoring](https://www.wearedevelopers.com/videos/1529-azure-well-architected-framework-designing-mission-critical-workloads-in-practice) (from "Azure-Well Architected Framework - designing mission critical workloads in practice")
- [Distinguishing between telemetry, monitoring, and observability](https://www.wearedevelopers.com/videos/100158-the-opentelemetry-mistakes-i-keep-seeing-and-how-to-stop-making-them) (from "The OpenTelemetry mistakes I keep seeing (and how to stop making them)")
- [Integrating OpenTelemetry pipeline platforms with embedded third-party observability providers](https://www.wearedevelopers.com/videos/841-hands-on-with-opentelemetry) (from "Hands on with OpenTelemetry")
- [Monitoring complex systems with complete observability](https://www.wearedevelopers.com/videos/100-react-and-the-power-of-visualisation) (from "React and the power of visualisation")

## Related Articles

- [Effortlessly Scale Prometheus With The Telemetry Data Platform – And Keep your Grafana Dashboards, Too!](https://www.wearedevelopers.com/magazine/3-effortlessly-scale-prometheus-with-the-telemetry-data-platform-and-keep-your-grafana-dashboards-too)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production](https://www.wearedevelopers.com/magazine/115-mlops-deploying-maintaining-and-evolving-machine-learning-models-in-production)
- [The Fastest JavaScript Charts - Built for React and Beyond](https://www.wearedevelopers.com/magazine/636-the-fastest-javascript-charts-built-for-react-and-beyond)

## Related Jobs

- [Lead Software Engineer - Data Engineering](https://www.wearedevelopers.com/jobs/ext/2000968-lead-software-engineer-data-engineering) at **Dynatrace**
- [Staff, Business Intelligence Engineer](https://www.wearedevelopers.com/jobs/ext/1401813-staff-business-intelligence-engineer) at **Twilio**
- [Staff Business Intelligence Engineer](https://www.wearedevelopers.com/jobs/ext/626164-staff-business-intelligence-engineer) at **Twilio**
- [Software Engineer, Platform Engineering (L2)](https://www.wearedevelopers.com/jobs/ext/1956829-software-engineer-platform-engineering-l2) at **Twilio**
- [Staff, Analytics Engineer](https://www.wearedevelopers.com/jobs/ext/569504-staff-analytics-engineer) at **Twilio**
- [Data Scientist](https://www.wearedevelopers.com/jobs/ext/1351648-data-scientist) at **Almedia**