Yasemin Aktürk

From Black Box to Glass Box : Bedrock AgentCore Observability

What if you could see every thought your AI agent has? Learn how to turn opaque black boxes into transparent glass boxes with full observability.

From Black Box to Glass Box : Bedrock AgentCore Observability
#1about 3 minutes

Understanding the building blocks of Amazon Bedrock Agent Core

Agent Core provides production-ready components like runtime, memory, and observability so you can focus on agent logic instead of infrastructure.

#2about 2 minutes

Exploring short-term and long-term agent memory

Agent Core automatically syncs conversation events to short-term memory for session context and long-term memory for persistent knowledge.

#3about 2 minutes

Overview of the example customer support agent architecture

The demo agent uses internal tools, an external server, and an AWS Lambda function via the Agent Core gateway to handle customer queries.

#4about 3 minutes

Navigating the Bedrock Agent Core observability dashboard

The AWS CloudWatch dashboard provides a high-level view of agent performance, including sessions, traces, token usage, and memory API calls.

#5about 5 minutes

Analyzing an agent trace with multiple tool calls

A detailed walkthrough of a trace shows how the agent correctly calls two different tools to answer a complex user question about product price and warranty.

#6about 1 minute

Examining a simple agent trace with a single tool call

This example demonstrates a straightforward scenario where the agent correctly identifies and calls a single internal tool to retrieve a return policy.

#7about 4 minutes

Using evaluation scores to debug incorrect agent behavior

When an agent fails to call the correct tool, the built-in correctness evaluation provides a low score and explains the factual error, helping you debug the agent's reasoning.

#8about 1 minute

Understanding agent traces that do not involve tool calls

An agent can answer questions about its own capabilities directly from its instructions without needing to invoke any external tools.

Related jobs
Jobs that call for the skills explored in this talk.

Featured Partners

Related Articles

View all articles

From learning to earning

Jobs that call for the skills explored in this talk.