WeAreDevelopers LIVE Nov 17, 2023

Develop AI-powered Applications with OpenAI Embeddings and Azure Search

Rainer Stropek

Stop splitting text by arbitrary character counts. Master the RAG pattern using OpenAI embeddings and Azure Search. Build fast, context-aware AI applications that cite their own sources.

Pause
Mute Enter Fullscreen
#1 about 3 min

Understanding embedding vectors and multi-dimensional spaces

Analogies of personality traits illustrate how text is converted into multi-dimensional numerical values representing meaning.

#2 about 3 min

Generating embeddings using the OpenAI API

Calling the embeddings endpoint via Microsoft Azure facilitates adherence to European GDPR requirements while processing data.

#3 about 5 min

Comparing vectors with cosine similarity and dot products

Calculating the dot product of normalized vectors determines the semantic similarity between different texts.

#4 about 5 min

Overview of the OpenAI API and state management

Building targeted frontend applications requires passing complete chat histories or utilizing newer thread APIs for state management.

#5 about 3 min

Understanding the core retrieval augmented generation pattern

Injecting current private facts into model prompts enables accurate answers without retraining the underlying language model.

#6 about 4 min

Defining the use case for a custom search assistant

Searching a complex institutional wiki requires a customized extraction and ingestion pipeline built with cross-platform frameworks.

#7 about 6 min

Extracting and preprocessing HTML data into markdown files

Custom crawlers navigate institutional databases to strip formatting elements and parse raw internet pages into clean markdown files.

#8 about 3 min

Splitting large texts into token-limited chunks for embeddings

Breaking documents into smaller pieces ensures text inputs remain below API limits during the embedding generation process.

#9 about 6 min

Storing calculated embeddings in Azure Cognitive Search

Writing pre-calculated embedding vectors into specialized databases optimizes retrieval speed during live semantic searches.

#10 about 5 min

Implementing query flows with vector searches and completions

Triggering nearest neighbor searches provides relevant document fragments which are streamed back directly as engineered prompts.

#11 about 5 min

Demonstrating the working console application and localized responses

Running the complete system via command-line effectively retrieves knowledge source materials and answers nuanced regional protocol questions.

#12 about 3 min

Addressing embedding calculations and model hallucination risks

Retaining source links in graphical interfaces helps users verify AI-generated answers and mitigate factual discrepancies.

#13 about 11 min

Navigating ethical development and selecting integration frameworks

Implementing content filters and tracking framework updates helps developers manage inevitable behavioral biases in rapid deployment cycles.

Matching moments

1:44 min

Understanding basic retrieval-augmented generation architectures in chatbots

Stan Girard Stan Girard · World Congress 2024

3:49 min

Implementing text chunking and retrieval augmented generation

Damir Damir · World Congress 2025

1:24 min

Expanding AI capabilities using retrieval-augmented generation

Cedric Clyburn Cedric Clyburn · World Congress 2024

1:28 min

Reviewing the basic retrieval-augmented generation pipeline

Carl Lapierre Carl Lapierre · World Congress 2024

1:37 min

Exploring common use cases for modern generative AI

Sandra Ahlgrimm Sandra Ahlgrimm +1 · World Congress 2024

3:37 min

Demonstrating semantic latency reductions using Spring AI configurations

Upcoming sessions on this topic

Open session

World Congress 2026 North America

September 23, 2026 · 10:00–17:00

Stage 11

Building Stuff with GenAI - The Open Minded Workshop beyond OpenAI

Andreas Erben

CTO for Applied AI and Metaverse at daenet

Andreas Erben
Open session

World Congress 2026 North America

September 25, 2026 · 10:20–10:50

Stage 5

Physical AI: 5 Things You Can Build That Aren't Another Chatbot

Vini Senger

Senior Technical Evangelist for Startups

Vini Senger
Open session

World Congress 2026 North America

September 24, 2026 · 14:10–14:40

Stage 5

Edge AI: Running Agentic Intelligence Where Internet Can't Reach

Nitin Eusebius

AWS - Principal Solutions Architect

Nitin Eusebius
Open session

World Congress 2026 North America

September 24, 2026 · 16:50–17:20

Stage 4

From Software Agents to Physical Devices: Inside the Agentic Hardware Stack

Michael Yuan, Vivian Hu

Michael Yuan
Vivian Hu
Open session

World Congress 2026 North America

September 25, 2026 · 13:30–14:00

Stage 4

From Model Selection to Smart Routing: How to Use the Right LLM for Every Task

Viktoria Semaan

Principal Technical Evangelist at Databricks

Viktoria Semaan
Open session

World Congress 2026 North America

September 24, 2026 · 16:10–16:40

Stage 3

Sandboxing the Swarm: Building Secure, Serverless AI Agents with Wasm

Thorsten Hans

Sr. Developer Advocate @ Akamai Technologies

Thorsten Hans