WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2026 North America • Sep 24, 2026 • Session details

Ploomloom - Startup pitch: Reliable evals for LLM and agent releases using Plumloom

Stop relying on flaky LLM evaluations for deployment decisions. Plumloom uses independent judges and statistical confidence intervals to automatically block bad AI releases in your pipeline.

Ploomloom - Startup pitch: Reliable evals for LLM and agent releases using Plumloom thumbnail

Checking access…

Playback and chapters load privately for Free videos.

Matching moments

2:36 min

Evaluating LLM applications beyond standard correctness benchmarks

Saloni Garg Saloni Garg · World Congress 2026 North America

1:56 min

Introduction to evaluating AI code review agents

Sofia Rest Sofia Rest · World Congress 2026 North America

1:31 min

Breaking complex artificial intelligence evaluations into testable pieces

Anita Ganti Anita Ganti · World Congress 2026 North America

4:42 min

Programmatic model evaluation and custom metrics via MLflow

Viktoria Semaan Viktoria Semaan · World Congress 2026 Europe

2:49 min

Executing automated evaluation suites leveraging LLMs as judges

Csenge Szabo Csenge Szabo · Europe 2026 Virtual

4:04 min

Evaluating model performance and accuracy using LLM judges

Viktoria Semaan Viktoria Semaan · World Congress 2026 North America

More from World Congress 2026 North America

2026 in LLMs (so far) thumbnail
31:31
10 days ago

2026 in LLMs (so far)

Simon Willison

Running Operations Without Humans in the Loop thumbnail
32:31
10 days ago

Running Operations Without Humans in the Loop

Edward Aryee, Ryan Ries, Yaron Schneider, Chris Hallenbeck, Floriane Gramlich

Beyond the Code: Human-AI Synergies in Product Development thumbnail
17:43
10 days ago

Beyond the Code: Human-AI Synergies in Product Development

Ajita Kanchivakam Ananth

Honey, look! I vibe-coded an OS! thumbnail
30:40
10 days ago

Honey, look! I vibe-coded an OS!

Ian Smith

The Productivity Illusion: What AI Really Changed for Developers thumbnail
24:28
10 days ago

The Productivity Illusion: What AI Really Changed for Developers

Fatih Kadir Akın

Your Evals Passed. Your Agent Just Emptied a Database. thumbnail
21:37
10 days ago

Your Evals Passed. Your Agent Just Emptied a Database.

Tejas Pravinbhai Patel

Related videos

Evals vs. Evil - AI and Package Security - Laurie Voss thumbnail
16:57
Coffee With Developers • 3 months ago

Evals vs. Evil - AI and Package Security - Laurie Voss

Laurie Voss

Beyond the Benchmark: How to Evaluate AI Agents in the Real World thumbnail
30:04
World Congress 2026 Europe • 3 months ago

Beyond the Benchmark: How to Evaluate AI Agents in the Real World

Taylor Jordan Smith

Teaching an LLM to review code … like a Senior Engineer! thumbnail
32:26
World Congress 2026 Europe • 3 months ago

Teaching an LLM to review code … like a Senior Engineer!

Kesha Mykhailov

Why LLMs Need Observability and How to Do It thumbnail
32:41
Europe 2026 Virtual • 3 months ago

Why LLMs Need Observability and How to Do It

Rahul Gupta

Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source thumbnail
29:50
World Congress 2026 Europe • 3 months ago

Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source

Viktoria Semaan

Reinventing Testing Practices in the AI Era thumbnail
30:19
World Congress 2026 North America • 11 days ago

Reinventing Testing Practices in the AI Era

Eric Deandrea

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.