Beyond the Hype: Building Trustworthy and Reliable LLM Applications with Guardrails
-
Alex Soto
Red Hat
Director of Developer Experience
The growth of GenAI & Machine Learning has brought new emerging challenges; in this talk we dive into the state of GenAI & ML in the ecosystem, where we provide an overview of trends, challenges, opportunities and tooling that the ecosystem is standardizing towards.
As part of this session, we will provide a snapshot of the current state of the ecosystem, as uncovered by recent surveys, which highlights the gaps in tooling and skills [1]. We will then cover the best practices and tooling that are arising from production use-cases of LLMOps/MLOps at scale to tackle domain-specific challenges such as agentic-workflows, AI guardrails, efficiency requirements - between others. These include the OSS frameworks [2] that are supporting the end-to-end LLMOps / MLOps lifecycle across pipelining, optimization, productionisation, monitoring/observability and ML safety.
World Congress 2025
Alex Soto
Red Hat
Director of Developer Experience
Maish Saidel-Keesing
AWS
Senior Developer Advocate
Roberto Carratalá
Red Hat
Principal AI Architect
Damir
daenet
Lead Sofwtare Architect