WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2026 Europe • Jul 9, 2026 • Session details

Unlocking the AI Black Box: Building Trust in the Era of Agentic Production

Jemiah Sius , Harry Kimpel

Are autonomous AI agents silently breaking your production code? Learn how OpenTelemetry exposes hidden LLM workflows to prevent behavioral failures, control token costs, and automate SRE operations.

Pause
Mute Enter Fullscreen
#1 about 5 min

Impact of AI on the software development lifecycle

How the pressure to increase code production significantly alters traditional software delivery cycles.

#2 about 3 min

Monitoring AI model quality and execution performance

Evaluating application interactions based on response quality, latency, and underlying model choice.

#3 about 1 min

Standardizing AI telemetry with the OpenTelemetry framework

Using an industry-standard framework to capture consistent tracing and log data from generative AI.

#4 about 3 min

Tracing agentic capabilities and step-by-step code execution

Observing what coding agents execute behind the scenes, including underlying bash scripts and token consumption.

#5 about 3 min

Debugging agentic tool calls and generation costs

Visualizing the sequence of operations, memory usage, and actual utility costs for troubleshooting prompts.

#6 about 2 min

Securing local AI development workflows against production failures

Leveraging open-source tracing locally to run safety checks on coding agents without extra overhead.

#7 about 4 min

Tracking operational challenges and incident response metrics

Connecting metric tracking directly to enterprise revenue by reducing incident investigation and mitigation times.

#8 about 3 min

Using AI for incident summaries and root cause analysis

Generating dynamic performance baselines and intelligent root cause explanations during application alerts.

#9 about 4 min

Implementing self-healing workflows for automated operations

Automating remediation workflows by deploying agents to evaluate alerts, draft fixes, and issue pull requests.

#10 about 3 min

Reducing downtime with intelligent AI observability pipelines

Integrating continuous feedback loops to detect issues instantly and resolve failures safely.

#11 about 2 min

Establishing shared team ownership for AI application observability

Distributing instrumentation and reliability responsibilities across platform teams, operations, and individual developers.

Matching moments

1:05 min

Implementing monitoring and observability for AI software deployments

Alejandro Saucedo Alejandro Saucedo · World Congress 2025

1:50 min

Managing observability using natural language AI agents

Alex Laubscher Alex Laubscher +3 · World Congress 2025

1:48 min

Adapting observability strategies for long-running enterprise AI agents

Christian Heilmann Christian Heilmann +3 · World Congress 2026 Europe

1:55 min

Identifying and fixing over-engineered AI calls through observability

diabhey diabhey · World Congress 2025

1:21 min

Leveraging generative AI for application observability and security

Jemiah Sius Jemiah Sius · World Congress 2023

3:04 min

Building trust and transparency into AI interactions

Ekaterina Streltsova Ekaterina Streltsova · Europe 2026 Virtual

More from World Congress 2026 Europe

Building the Nervous System of AI - Michael Kagan (NVIDIA) thumbnail
29:17
2 months ago

Building the Nervous System of AI - Michael Kagan (NVIDIA)

Michael Kagan, Sead Ahmetović

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote thumbnail
19:41
2 months ago

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote

Christian Heilmann

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend thumbnail
32:06
2 months ago

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend

David vonThenen

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes thumbnail
35:13
2 months ago

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes

Irina Branovic

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬 thumbnail
24:23
2 months ago

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬

Jeremy Murray

Angstfreude - AI and Corporate Culture - The Thrill and the Threat thumbnail
30:26
2 months ago

Angstfreude - AI and Corporate Culture - The Thrill and the Threat

Axel Ebert, Karin Krobath

Upcoming sessions on this topic

Open session

World Congress 2026 North America

September 24, 2026 · 10:20–10:50

Stage 4

AI Decision Observability: Enabling Transparency and Trust in Intelligent Systems

Amjad Shaikh, Soumil Mandal

Amjad Shaikh
Soumil Mandal
Open session

World Congress 2026 North America

September 25, 2026 · 15:45–15:55

Outdoor Stage

Closing the Visibility Gap: Lessons from Safety Critical Agentic Systems

Vivek Pandit

Frontier AI Lead at Turing

Vivek Pandit
Open session

World Congress 2026 North America

September 24, 2026 · 11:00–11:30

Stage 5

The Missing Infrastructure for AI Agents

Chris Waterson

CTO and Co-Founder of Guild.ai

Chris Waterson
Open session

World Congress 2026 North America

September 24, 2026 · 11:40–12:10

Stage 4

Taming Rogue Agents: Observability-Driven Evaluation for Production Reliability

Anagha Rumade, Anjana Umapathy, Apoorva Jaiswal

Anagha Rumade
Anjana Umapathy
Apoorva Jaiswal
Open session

World Congress 2026 North America

September 25, 2026 · 11:40–12:10

Stage 2

Reinventing Testing Practices in the AI Era

Eric Deandrea

Java Champion & Senior Principal Software Engineer at IBM

Eric Deandrea
Open session

World Congress 2026 North America

September 24, 2026 · 11:10–11:15

Outdoor Stage

Architecting the 100X SDLC: Building Production Trust into AI-Assisted Delivery

Ranjan Parthasarathy

Founder, CPTO/CEO at AXIOMSTUDIO.AI

Ranjan Parthasarathy

Related videos

What Production Knows: Closing the Loop Between AI Agents and the Systems They Build thumbnail
26:33
World Congress 2026 Europe • 2 months ago

What Production Knows: Closing the Loop Between AI Agents and the Systems They Build

May Walter

Mastering AI-Driven Problem Solving in Engineering with Observability thumbnail
27:39
World Congress 2024 • about 2 years ago

Mastering AI-Driven Problem Solving in Engineering with Observability

Jemiah Sius

Running AI at Scale: The Secret Ingredients thumbnail
30:04
World Congress 2026 Europe • 2 months ago

Running AI at Scale: The Secret Ingredients

Boris Hecker, Max Tschochohei, Peter Kürpick, Tomislav Tipurić

What 500+ Production Environments Taught Us About Shipping AI Agents thumbnail
23:05
World Congress 2026 Europe • 2 months ago

What 500+ Production Environments Taught Us About Shipping AI Agents

Liran Hason

The Last Mile of AI: From Prototype to Production thumbnail
28:23
World Congress 2026 Europe • 2 months ago

The Last Mile of AI: From Prototype to Production

Clemens Wasner, Holger Hammel, Martin Remmelgas, Max Jacobson, Marius Cosareanu

Why LLMs Need Observability and How to Do It thumbnail
32:41
Europe 2026 Virtual • 2 months ago

Why LLMs Need Observability and How to Do It

Rahul Gupta

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.