Christian Weyer

Semantic AI: Why Embeddings Might Matter More Than LLMs

Are we too focused on LLMs? This talk argues that embeddings are the true foundation of modern AI, enabling powerful, deterministic systems for retrieval and routing.

Semantic AI: Why Embeddings Might Matter More Than LLMs
#1about 1 minute

Moving beyond hype with real-world generative AI

An internal company tool serves as a practical case study for applying language and embedding models to solve real business problems.

#2about 3 minutes

Integrating AI with existing enterprise data sources

The system combines API-based data from a third-party planning tool with document-based data from a Git-based knowledge base.

#3about 4 minutes

Building language-enabled universal interfaces for software

Instead of extending traditional GUIs, a universal interface allows users to interact with systems using natural language through platforms like Slack or voice.

#4about 3 minutes

Demonstrating a multi-system AI chat interface

A live demo shows how a single chat interface can query both a knowledge base and an employee availability system, providing source links to verify information.

#5about 3 minutes

Contrasting language models and embedding models

Language models are non-deterministic and generative, while embedding models are deterministic and create vector representations for comparison and retrieval.

#6about 4 minutes

Implementing retrieval-augmented generation for documents

The RAG pattern uses embeddings and a vector database to find relevant document chunks to provide as context for an LLM's answer.

#7about 4 minutes

Using LLMs for structured data and API calls

By providing a technical schema in the prompt, a language model can be forced to generate structured, machine-readable output for reliable API integration.

#8about 4 minutes

How semantic routing directs user queries

Semantic routing uses embeddings to classify a user's intent by finding the closest cluster of example questions, directing the request to the correct backend system.

#9about 1 minute

Why embeddings are the foundation of AI systems

Embeddings are crucial not just within LLMs but also for encoding meaning and enabling core architectural patterns like semantic routing and guarding.

Related jobs
Jobs that call for the skills explored in this talk.

Matching moments

Understanding the role of embeddings and vector databases
02:02 MIN

Understanding the role of embeddings and vector databases

Best practices: Building Enterprise Applications that leverage GenAI

The future of LLMs as a seamless user experience
03:34 MIN

The future of LLMs as a seamless user experience

How to Avoid LLM Pitfalls - Mete Atamel and Guillaume Laforge

Three pillars for integrating LLMs in products
01:47 MIN

Three pillars for integrating LLMs in products

Using LLMs in your Product

Demystifying AI by exploring human language processing
07:57 MIN

Demystifying AI by exploring human language processing

WeAreDevelopers LIVE – PHP Is Alive and Kicking and More

Q&A on embedding calculation, ethics, and tooling
13:11 MIN

Q&A on embedding calculation, ethics, and tooling

Develop AI-powered Applications with OpenAI Embeddings and Azure Search

Securely connecting generative AI to enterprise data
02:32 MIN

Securely connecting generative AI to enterprise data

How E.On productionizes its AI model & Implementation of Secure Generative AI.

Addressing the core challenges of large language models
05:18 MIN

Addressing the core challenges of large language models

Accelerating GenAI Development: Harnessing Astra DB Vector Store and Langflow for LLM-Powered Apps

Bridging the gap between language models and software
01:59 MIN

Bridging the gap between language models and software

When worlds collide: How will generative AI change the way we design and build software

Featured Partners

Related Videos

See all videos
AI: Superhero or Supervillain? How and Why with Scott Hanselman25:17

AI: Superhero or Supervillain? How and Why with Scott Hanselman

Scott Hanselman

Best practices: Building Enterprise Applications that leverage GenAI24:24

Best practices: Building Enterprise Applications that leverage GenAI

Damir

GenAI Unpacked: Beyond Basic27:12

GenAI Unpacked: Beyond Basic

Damir

Inside the Mind of an LLM27:11

Inside the Mind of an LLM

Emanuele Fabbiani

How AI Models Get Smarter35:16

How AI Models Get Smarter

Ankit Patel

Exploring LLMs across clouds28:38

Exploring LLMs across clouds

Tomislav Tipurić

Bringing the power of AI to your application.32:26

Bringing the power of AI to your application.

Krzysztof Cieślak

Unveiling the Magic: Scaling Large Language Models to Serve Millions31:25

Unveiling the Magic: Scaling Large Language Models to Serve Millions

Patrick Koss

Related Articles

View all articles
CH
Chris Heilmann
WebMCP: Empowering Agents as First-Class Citizens of the Web
WebMCP is an exciting W3C proposal that just landed in Chrome Canary to try out . The idea is that you can use some HTML attributes on a form or register JavaScript tool methods to give agents direct access to content. This gives us as content prov...
WebMCP: Empowering Agents as First-Class Citizens of the Web
DC
Daniel Cranney
Stephan Gillich - Bringing AI Everywhere
In the ever-evolving world of technology, AI continues to be the frontier for innovation and transformation. Stephan Gillich, from the AI Center of Excellence at Intel, dove into the subject in a recent session titled "Bringing AI Everywhere," sheddi...
Stephan Gillich - Bringing AI Everywhere
CH
Chris Heilmann
With AIs wide open - WeAreDevelopers at All Things Open 2025
Last week our VP of Developer Relations, Chris Heilmann, flew to Raleigh, North Carolina to present at All Things Open . An excellent event he had spoken at a few times in the past and this being the “Lucky 13” edition, he didn’t hesitate to come and...
With AIs wide open - WeAreDevelopers at All Things Open 2025

From learning to earning

Jobs that call for the skills explored in this talk.