> Markdown version of [/events/world-congress-2026-europe-virtual-stage/sessions/1606-stop-guessing-start](https://www.wearedevelopers.com/events/world-congress-2026-europe-virtual-stage/sessions/1606-stop-guessing-start). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Stop Guessing, Start Measuring: Evaluating RAG Systems with Synthetic Test Data


- **Event:** World Congress 2026 Europe - Virtual Stage

## Recording

[Watch recording](https://www.wearedevelopers.com/videos/1982-stop-guessing-start-measuring-evaluating-rag-systems-with-synthetic-test-data)

## Description

Most RAG systems go to production without proper evaluation — mainly because building a comprehensive test dataset feels like a project in itself. What if it doesn't have to be?
In this live coding session, we'll generate a synthetic test dataset using RAGAS and its knowledge graph approach — no manual question-answer curation needed. Using the public dataset as our document base, we'll build a test dataset from scratch and run it against an existing RAG pipeline, all live.
Along the way, we'll measure the metrics that actually tell you whether your system works: context precision, context recall, noise sensitivity, response relevancy, and faithfulness. You'll see how synthetic test data from knowledge graphs covers edge cases that manually curated sets typically miss.
This session comes from production experience with RAGAS and is designed for developers who work with RAG, LLMs and AI agents, and want a reliable, low-effort evaluation workflow they can take home and use immediately.

## Speaker

### [Csenge Szabo](https://www.wearedevelopers.com/@csenge-szabo)

AI Engineer at Onefold AI


## Related talks at this congress

- [Building an AI-Ready Content Lake: Scaling RAG and Document AI Beyond Demos](https://www.wearedevelopers.com/events/world-congress-2026-europe-virtual-stage/sessions/1506-building-an-ai-ready) — Angel Borroy
- [Beyond Dashboards: Fixing Text-to-SQL with Semantic RAG](https://www.wearedevelopers.com/events/world-congress-2026-europe-virtual-stage/sessions/1498-beyond-dashboards) — Piotr Menclewicz
- [AI as a Test Designer: Transforming Experience into Automated Testing](https://www.wearedevelopers.com/events/world-congress-2026-europe-virtual-stage/sessions/1482-ai-as-a-test) — Alisa Hrustic
- [From minutes to seconds: Lessons learned optimizing multi-turn agentic workflows](https://www.wearedevelopers.com/events/world-congress-2026-europe-virtual-stage/sessions/1544-from-minutes-to) — Douglas Reiser