Viktoria Semaan

Beyond Prompting: Building Scalable AI with Multi-Agent Systems and MCP

Stop building monolithic LLM agents. Learn how a microservices approach using multi-agent systems creates truly scalable and powerful AI.

Beyond Prompting: Building Scalable AI with Multi-Agent Systems and MCP
#1about 4 minutes

Understanding LLMs, context windows, and RAG

Large language models use tokens to process text, but their limited context window requires retrieval-augmented generation (RAG) to access large or real-time datasets.

#2about 3 minutes

Transitioning from monolithic agents to multi-agent systems

Giving a single LLM agent too many tools leads to confusion and failure, so a multi-agent architecture with specialized agents improves performance and scalability.

#3about 3 minutes

Why AI projects fail and the need for evaluation

Most AI proofs-of-concept fail in production due to a lack of business context, highlighting the need for robust evaluation frameworks like MLflow.

#4about 4 minutes

Demo: Evaluating an agent's RAG tool using MLflow

A practical demonstration shows how to use MLflow with custom metrics like relevance and specificity to identify and fix agent hallucinations in a RAG tool.

#5about 3 minutes

Introducing the Model Context Protocol for tool integration

The Model Context Protocol (MCP) standardizes how agents connect to tools, creating a reusable ecosystem of servers and clients to avoid redundant integration work.

#6about 6 minutes

Demo: Automating workflows with MCP servers and clients

This demo showcases connecting local files, GitHub, and Databricks Genie as MCP servers to a client, enabling complex, automated workflows from a single chat interface.

#7about 2 minutes

Exploring the current limitations and future of MCP

The current challenges for MCP include tool discovery, agent confusion from overlapping server functions, and the lack of a centralized security gateway.

Related jobs
Jobs that call for the skills explored in this talk.

Machine Learning Engineer

Picnic Technologies B.V.

Picnic Technologies B.V.
Amsterdam, Netherlands

Intermediate
Senior
Python
Structured Query Language (SQL)
+1

Matching moments

Increasing the value of talk recordings post-event
04:57 MIN

Increasing the value of talk recordings post-event

Cat Herding with Lions and Tigers - Christian Heilmann

Organizing a developer conference for 15,000 attendees
01:32 MIN

Organizing a developer conference for 15,000 attendees

Cat Herding with Lions and Tigers - Christian Heilmann

Selecting strategic partners and essential event tools
03:17 MIN

Selecting strategic partners and essential event tools

Cat Herding with Lions and Tigers - Christian Heilmann

Why corporate AI adoption lags behind the hype
03:28 MIN

Why corporate AI adoption lags behind the hype

What 2025 Taught Us: A Year-End Special with Hung Lee

The future of recruiting beyond talent acquisition
03:15 MIN

The future of recruiting beyond talent acquisition

What 2025 Taught Us: A Year-End Special with Hung Lee

Using AI agents to modernize legacy COBOL systems
06:28 MIN

Using AI agents to modernize legacy COBOL systems

Devs vs. Marketers, COBOL and Copilot, Make Live Coding Easy and more - The Best of LIVE 2025 - Part 3

Moving beyond headcount to solve business problems
04:27 MIN

Moving beyond headcount to solve business problems

What 2025 Taught Us: A Year-End Special with Hung Lee

Incentivizing automation with a 'keep what you kill' policy
05:18 MIN

Incentivizing automation with a 'keep what you kill' policy

What 2025 Taught Us: A Year-End Special with Hung Lee

Featured Partners

Related Videos

See all videos
From A2A to MCP: How AI’s “Brains” are Connecting to “Arms and Legs”24:12

From A2A to MCP: How AI’s “Brains” are Connecting to “Arms and Legs”

Brad Axen

Beyond Chatbots: How to build Agentic AI systems24:22

Beyond Chatbots: How to build Agentic AI systems

Philipp Schmid

Agentic AI - From Theory to Practice: Developing Multi-Agent AI Systems on Azure26:35

Agentic AI - From Theory to Practice: Developing Multi-Agent AI Systems on Azure

Ricardo

On a Secret Mission: Developing AI Agents29:03

On a Secret Mission: Developing AI Agents

Jörg Neumann

MCP Mashups: How AI Agents are Reviving the Programmable Web23:17

MCP Mashups: How AI Agents are Reviving the Programmable Web

Angie Jones

Agents for the Sake of Happiness39:11

Agents for the Sake of Happiness

Thomas Dohmke

Azure AI Foundry for Developers: Open Tools, Scalable Agents, Real Impact23:33

Azure AI Foundry for Developers: Open Tools, Scalable Agents, Real Impact

Oliver Will

Building Blocks for Agentic Solutions in your Enterprise23:39

Building Blocks for Agentic Solutions in your Enterprise

Dennis Zielke & Rene Pajta

Related Articles

View all articles
CH
Chris Heilmann
Everything a Developer Needs to Know About MCP with Neo4j
In the rapidly evolving world of AI tooling and agentic workflows, one protocol is reshaping how developers build, scale, and share AI-native applications: the Model Context Protocol (MCP). If you’ve been building AI agents, you know the pain of inte...
Everything a Developer Needs to Know About MCP with Neo4j
DC
Daniel Cranney
Dev Digest 164: AI Agents, AI Blindspots and MCP security problems
Inside last week’s Dev Digest 164 . 📈 State of AI in charts 🕵️‍♂️ What are AI Agents? 🤖 AI blindspots 🙅‍♂️ Everything wrong with MCP ⚠️ Threat modelling GitHub 🤩 Non LLM software trends to be excited about 💻 Caching explained 🐕‍🦺 Keeping Amazon Web ...
Dev Digest 164: AI Agents, AI Blindspots and MCP security problems
DC
Daniel Cranney
Stephan Gillich - Bringing AI Everywhere
In the ever-evolving world of technology, AI continues to be the frontier for innovation and transformation. Stephan Gillich, from the AI Center of Excellence at Intel, dove into the subject in a recent session titled "Bringing AI Everywhere," sheddi...
Stephan Gillich - Bringing AI Everywhere

From learning to earning

Jobs that call for the skills explored in this talk.