> Markdown version of [/events/conference-india-2026/sessions/2044-building-a-semantic](https://www.wearedevelopers.com/events/conference-india-2026/sessions/2044-building-a-semantic). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Building a Semantic Cache for Agentic AI: Practical workshop on reducing cost & latency


- **Event:** Conference India 2026

## Description

Imagine your pager going off at 3 AM, only to find that your LLM costs are about to exceed their threshold. Generative AI applications become slow and expensive when every user request is routed directly to an LLM. 

This workshop introduces the fundamentals of semantic caching, explaining how it differs from traditional key-based caching. We’ll explore where semantic caching fits within a modern LLM stack and walk through practical implementation patterns. 

We’ll build using a real Semantic Cache for an AI Application, measure its effectiveness and improve its effectiveness.

## Speaker

### [Bhavana Giri](https://www.wearedevelopers.com/@bhavana-giri)

Developer Advocate| Software Engineer 


## Related talks at this congress

- [Build a Zero-Cost AI Agent in Your Browser](https://www.wearedevelopers.com/events/conference-india-2026/sessions/1980-build-a-zero-cost-ai) — Aishwarya Mathuria, Nishant Thakur
- [Enterprise AI Memory at Scale](https://www.wearedevelopers.com/events/conference-india-2026/sessions/2038-enterprise-ai-memory) — Aditya Joshi
- [Architecting Trusted AI: Coupling Multi-Agent Systems with dbt Semantic Store for Zero-Hallucination](https://www.wearedevelopers.com/events/conference-india-2026/sessions/1976-architecting-trusted) — Pushkar Mishra
- [Bypassing the GPU Tax: Smart Layer-7 Routing with Small Language Models (SLMs)](https://www.wearedevelopers.com/events/conference-india-2026/sessions/2040-bypassing-the-gpu) — Sagar Utekar

## Watch remotely

Can’t make it to Bengaluru? Watch this session live with Pro. You also get:

- All full videos, bookmarks, and playlists
- World Congress livestreams

[See pricing](https://www.wearedevelopers.com/pricing)

## Links

- [Get tickets](https://www.wearedevelopers.com/conference-india/tickets)