> Markdown version of [/playlists/ai-observability](https://www.wearedevelopers.com/playlists/ai-observability). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Playlist: AI observability 13 videos · 15 moments · 33.7 minutes ## The State of GenAI & Machine Learning in 2025 - **Implementing monitoring and observability for AI software deployments** (21:17, 1min) — Maintaining operational stability in non-deterministic systems demands specialized observability practices like drift detection and automated perfo... [Learn more](https://www.wearedevelopers.com/videos/1383-the-state-of-genai-machine-learning-in-2025) ## Analytics in the Age of Agentic AI: A tour of ClickHouse and Langfuse - **Addressing AI observability and cost transparency with Langfuse** (10:28, 2min) — Visibility into model operations brings immediate clarity to token expenditures and the reliability of non-deterministic outputs. [Learn more](https://www.wearedevelopers.com/videos/100240-analytics-in-the-age-of-agentic-ai-a-tour-of-clickhouse-and-langfuse) ## Unlocking the AI Black Box: Building Trust in the Era of Agentic Production - **Reducing downtime with intelligent AI observability pipelines** (23:15, 2min) — Integrating continuous feedback loops to detect issues instantly and resolve failures safely. - **Establishing shared team ownership for AI application observability** (25:44, 1min) — Distributing instrumentation and reliability responsibilities across platform teams, operations, and individual developers. [Learn more](https://www.wearedevelopers.com/videos/100086-unlocking-the-ai-black-box-building-trust-in-the-era-of-agentic-production) ## From Traction to Production: Maturing your GenAIOps step by step - **Monitoring enterprise AI workloads for continuous observability** (23:08, 1min) — Instrumenting applications with SDKs to visualize telemetry and operational metrics in dedicated dashboards. [Learn more](https://www.wearedevelopers.com/videos/1535-from-traction-to-production-maturing-your-genaiops-step-by-step) ## The AI-Ready Stack: Rethinking the Engineering Org of the Future - **Managing observability using natural language AI agents** (01:29, 1min) — How observability workflows transition toward natural language requests and direct fixes in development tools. [Learn more](https://www.wearedevelopers.com/videos/1706-the-ai-ready-stack-rethinking-the-engineering-org-of-the-future) ## Shipping with Confidence: Observability and Quality at Scale - **Adapting observability strategies for long-running enterprise AI agents** (18:55, 1min) — Monitoring autonomous entities requires shifting from fast request-response metrics to tracking extensive agentic workflows and mathematically eval... [Learn more](https://www.wearedevelopers.com/videos/100166-shipping-with-confidence-observability-and-quality-at-scale) ## Building APIs for Agents vs Systems. Is MCP the answer? - **Building observability to verify unexpected AI agent behavior** (22:04, 1min) — Robust monitoring acts as an essential diagnostic tool when AI models hallucinate or falsely report API execution paths. [Learn more](https://www.wearedevelopers.com/videos/100291-building-apis-for-agents-vs-systems-is-mcp-the-answer) ## Observability with OpenTelemetry & Elastic - **The increasing complexity of modern application observability** (00:02, 1min) — As applications and generative AI solutions become more complex, standardized monitoring processes are required to diagnose unexpected failures. [Learn more](https://www.wearedevelopers.com/videos/1232-observability-with-opentelemetry-elastic) ## Why shifting left is so important for software developers - **Leveraging generative AI for application observability and security** (21:29, 1min) — Applying automated assistants to system telemetry simplifies troubleshooting and vulnerability resolution. [Learn more](https://www.wearedevelopers.com/videos/598-why-shifting-left-is-so-important-for-software-developers) ## Reference Architecture of AI in the Cloud - **Following a logical progression for cloud modernization** (24:17, 2min) — Transitioning legacy systems to AI-ready architectures requires stepping systematically through compute scaling, data consolidation, automation, an... [Learn more](https://www.wearedevelopers.com/videos/1613-reference-architecture-of-ai-in-the-cloud) ## What 500+ Production Environments Taught Us About Shipping AI Agents - **Building an agentic observability system for telemetry data** (00:00, 1min) — An overview of an agentic system that queries logs, metrics, and traces to investigate production root causes. [Learn more](https://www.wearedevelopers.com/videos/100024-what-500-production-environments-taught-us-about-shipping-ai-agents) ## Event-Driven Architecture: Breaking Conversational Barriers with Distributed AI Agents - **Identifying and fixing over-engineered AI calls through observability** (17:24, 1min) — How unexpected billing outputs and application tracing tools revealed the need to restrict external language model inferences. [Learn more](https://www.wearedevelopers.com/videos/1465-event-driven-architecture-breaking-conversational-barriers-with-distributed-ai-agents) ## Mastering AI-Driven Problem Solving in Engineering with Observability - **Understanding observability in highly complex distributed environments** (00:02, 5min) — Managing thousands of microservices and deployments requires a methodical approach to tracking system health. - **Establishing proper data sources and observability platform capabilities** (10:02, 4min) — Capturing data across application layers and leveraging anomaly detection simplifies finding configuration errors and silent corruptions. [Learn more](https://www.wearedevelopers.com/videos/994-mastering-ai-driven-problem-solving-in-engineering-with-observability)