World Congress 2024 • Aug 20, 2024 • Session details

Mastering AI-Driven Problem Solving in Engineering with Observability

Jemiah Sius

Stop guessing in the dark during on-call emergencies. Master a systematic observability loop to resolve infrastructure bottlenecks and eliminate unique AI hallucinations using RAG and distributed traces.

Pause
Mute Enter Fullscreen
#1 about 6 min

Understanding observability in highly complex distributed environments

Managing thousands of microservices and deployments requires a methodical approach to tracking system health.

#2 about 5 min

Utilizing essential telemetry data types for problem detection

Understanding when to use metrics, events, logs, and distributed traces enables granular system troubleshooting.

#3 about 5 min

Establishing proper data sources and observability platform capabilities

Capturing data across application layers and leveraging anomaly detection simplifies finding configuration errors and silent corruptions.

#4 about 7 min

Following a repeatable framework for incident source identification

Tracing symptoms downstream to local and remote dependencies eliminates trial and error during outages.

#5 about 4 min

Mitigating artificial intelligence hallucinations with constraints and context

Managing large language model inaccuracies requires input constraints and retrieval-augmented generation to provide missing domain knowledge.

#6 about 4 min

Balancing performance and costs with custom language models

Transitioning from token-based consumption to smaller bespoke models reduces latency and ensures data privacy in production environments.

Matching moments

1:59 min

Implementing observability to diagnose and resolve AI application failures

Sean O'Dell Sean O'Dell +1 · World Congress 2026 North America

1:05 min

Implementing monitoring and observability for AI software deployments

Alejandro Saucedo Alejandro Saucedo · World Congress 2025

1:55 min

Identifying and fixing over-engineered AI calls through observability

diabhey diabhey · World Congress 2025

1:48 min

Adapting observability strategies for long-running enterprise AI agents

Christian Heilmann Christian Heilmann +3 · World Congress 2026 Europe

1:21 min

Leveraging generative AI for application observability and security

Jemiah Sius Jemiah Sius · World Congress 2023

2:03 min

Solving complex engineering challenges in artificial intelligence deployment

Nico Axtmann · World Congress 2022

Upcoming sessions on this topic

Open session

Architecting Trusted AI: Coupling Multi-Agent Systems with dbt Semantic Store for Zero-Hallucination

  • Pushkar Mishra

    J.P. Morgan

    Senior Vice President

Open session

Autopsy of an Autonomous Incident: When the Agent Made It Worse

  • Navin Pai

    StackGen

    Director of Engineering

Open session

Teaching AI Coding Agents to Build It Right the First Time

  • Sajeetharan Sinnathurai

    Microsoft

    Principal Product Manager

Open session

From Prompt Engineering to Harness Engineering: Building Observable and Governed GenAI Systems

  • Lakshmi Devi Prakash

    JPMorgan Chase

    VP, Applied AI/ML Lead

Open session

How 8 GPUs Became 16: Rethinking LLM Inference Through Parallelism, Memory, and Runtime Design

  • Purnima Kumari

    DigitalOCean

    Sr. Solutions Architect II

Open session

AI Is the Easy Part: Why Faster Engineers Don't Make Faster Businesses

  • Bharat Sharma

    Booking

    Senior Engineering Manager