> Markdown version of [/videos/1639-apitoolkit-using-merkle-trees-and-llms-to-detect-the-undetectable-in-software-monitoring](https://www.wearedevelopers.com/videos/1639-apitoolkit-using-merkle-trees-and-llms-to-detect-the-undetectable-in-software-monitoring). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # APItoolkit: Using Merkle Trees and LLMs to Detect the UnDetectable in Software Monitoring Are missing fields during your deployments silently causing massive data disruptions? Discover how combining Merkle trees and LLMs instantly exposes undetectable software anomalies hidden inside your server logs. - **Speakers:** [Anthony Alaribe](https://www.wearedevelopers.com/@anthony-alaribe) - **Event:** World Congress 2025 - **Published:** August 20, 2025 - **Duration:** 4:58 - **URL:** https://www.wearedevelopers.com/videos/1639-apitoolkit-using-merkle-trees-and-llms-to-detect-the-undetectable-in-software-monitoring ## Summary Fast-moving engineering teams often struggle with deployment monitoring, where seemingly minor issues—such as missing fields during a migration—can lead to massive financial losses and data disruption. When incidents inevitably occur, developers are typically overwhelmed by a flood of logs, metrics, and fragmented communications across Slack channels. Monoscope (formerly APItoolkit) addresses this by functioning as an intelligent post-deployment observability platform. The system leverages merkle trees to condense millions of server logs, requests, and errors into distinct, manageable signatures. This enables real-time anomaly detection by instantly identifying when a new or unexpected payload signature appears within the infrastructure. Building on this foundation, the platform integrates LLMs to assess whether these newly detected variations are critical breaking changes or benign updates. By analyzing requests, traces, and logs within a unified context, engineers can chat directly with their observability data. This conversational AI approach transforms time-sensitive system diagnostics, actively streamlining incident resolution by replacing chaotic messaging channels with an efficient, context-aware troubleshooting interface. **Keywords:** monoscope, apitoolkit, software monitoring, post-deployment observability, merkle trees, LLMs, incident management, log analysis, anomaly detection, real-time monitoring, deployment troubleshooting, breaking changes, system diagnostics, payload signatures, conversational ai ## Chapters 1. **Introducing Monoscope for intelligent post-deployment system monitoring** (00:00) — Monoscope was created to actively analyze logs, metrics, and systems to automatically assist with post-deployment issue resolution. 1. **Why minor migration errors inspire automated anomaly detection systems** (00:39) — A costly production failure involving missing application fields demonstrates why systems must actively identify unexpected behavioral shifts. 1. **Managing information overload during complex production system incidents** (02:12) — Fast-moving teams often struggle with excess diagnostic data and scattered channel communication when attempting to resolve outages. 1. **Using Merkle trees to compress logs into distinct signatures** (03:07) — Utilizing Merkle trees condenses millions of incoming payloads into unique signatures to immediately flag previously unseen anomalies. 1. **Applying large language models to evaluate real-time system changes** (03:58) — Combining language models with observability data enables context-aware impact analysis and conversational interactions during incident responses. ## Related Moments - [Investigating anomalous operational metric logs directly and securely](https://www.wearedevelopers.com/videos/1624-30-powerful-aws-hacks-in-just-30-minutes-boost-your-developer-productivity) (from "30 powerful AWS hacks in just 30 minutes: Boost your developer productivity") - [Managing observability using natural language AI agents](https://www.wearedevelopers.com/videos/1706-the-ai-ready-stack-rethinking-the-engineering-org-of-the-future) (from "The AI-Ready Stack: Rethinking the Engineering Org of the Future") - [Elevating observability with anomaly detection and root cause analysis](https://www.wearedevelopers.com/videos/853-navigating-the-ai-wave-in-devops) (from "Navigating the AI Wave in DevOps") - [Monitoring enterprise AI workloads for continuous observability](https://www.wearedevelopers.com/videos/1535-from-traction-to-production-maturing-your-genaiops-step-by-step) (from "From Traction to Production: Maturing your GenAIOps step by step") - [Using AI for incident summaries and root cause analysis](https://www.wearedevelopers.com/videos/100086-unlocking-the-ai-black-box-building-trust-in-the-era-of-agentic-production) (from "Unlocking the AI Black Box: Building Trust in the Era of Agentic Production") - [Leveraging generative AI for application observability and security](https://www.wearedevelopers.com/videos/598-why-shifting-left-is-so-important-for-software-developers) (from "Why shifting left is so important for software developers") ## Related Articles - [MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production](https://www.wearedevelopers.com/magazine/115-mlops-deploying-maintaining-and-evolving-machine-learning-models-in-production) - [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it) - [Dev Digest 137 - AI'm not sure about this](https://www.wearedevelopers.com/magazine/485-dev-digest-137-ai-m-not-sure-about-this) - [Dev Digest 138 - Are you secure about this?](https://www.wearedevelopers.com/magazine/486-dev-digest-138-are-you-secure-about-this) ## Related Jobs - [Senior Engineer, Infrastructure Platform](https://www.wearedevelopers.com/jobs/ext/328836-senior-engineer-infrastructure-platform) at **Intercom, Inc.** - [Machine Learning Engineer](https://www.wearedevelopers.com/jobs/ext/588393-machine-learning-engineer) at **Twilio** - [Engineer, Offensive Security Organization](https://www.wearedevelopers.com/jobs/ext/1992296-engineer-offensive-security-organization) at **Twilio** - [Senior AI Agent Software Engineer (Go, Python) (m/f/x)](https://www.wearedevelopers.com/jobs/48277-senior-ai-agent-software-engineer-go-python-m-f-x) at **Dynatrace** - [AI Software Engineer (Germany)](https://www.wearedevelopers.com/jobs/48317-ai-software-engineer-germany) at **Sunhat** - [Machine Learning Engineer](https://www.wearedevelopers.com/jobs/ext/1355348-machine-learning-engineer) at **TWILIO**