WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2026 North America • Sep 24, 2026 • Session details

Ploomloom - Startup pitch: Reliable evals for LLM and agent releases using Plumloom

Stop relying on flaky LLM evaluations for deployment decisions. Plumloom uses independent judges and statistical confidence intervals to automatically block bad AI releases in your pipeline.

Starting at 1:12 · Watch from the beginning

Ploomloom - Startup pitch: Reliable evals for LLM and agent releases using Plumloom thumbnail

Checking access…

Playback and chapters load privately for Free videos.

Matching moments

2:36 min

Evaluating LLM applications beyond standard correctness benchmarks

Saloni Garg Saloni Garg · World Congress 2026 North America

1:56 min

Introduction to evaluating AI code review agents

Sofia Rest Sofia Rest · World Congress 2026 North America

1:31 min

Breaking complex artificial intelligence evaluations into testable pieces

Anita Ganti Anita Ganti · World Congress 2026 North America

4:42 min

Programmatic model evaluation and custom metrics via MLflow

Viktoria Semaan Viktoria Semaan · World Congress 2026 Europe

2:49 min

Executing automated evaluation suites leveraging LLMs as judges

Csenge Szabo Csenge Szabo · Europe 2026 Virtual

4:04 min

Evaluating model performance and accuracy using LLM judges

Viktoria Semaan Viktoria Semaan · World Congress 2026 North America

More from World Congress 2026 North America

2026 in LLMs (so far) thumbnail
31:31

2026 in LLMs (so far)

Simon Willison · Datasette /Django

Running Operations Without Humans in the Loop thumbnail
32:31

Running Operations Without Humans in the Loop

Edward Aryee +4

Beyond the Code: Human-AI Synergies in Product Development thumbnail
17:43

Beyond the Code: Human-AI Synergies in Product Development

Ajita Kanchivakam Ananth · Google

Honey, look! I vibe-coded an OS! thumbnail
30:40

Honey, look! I vibe-coded an OS!

Ian Smith · LYOS

The Productivity Illusion: What AI Really Changed for Developers thumbnail
24:28

The Productivity Illusion: What AI Really Changed for Developers

Fatih Kadir Akın · WordPress/Automattic

Your Evals Passed. Your Agent Just Emptied a Database. thumbnail
21:37

Your Evals Passed. Your Agent Just Emptied a Database.

Tejas Pravinbhai Patel · Amazon

Upcoming sessions on this topic

Open session

Did the Model Improve, or Just the Score? A Developer’s Guide to LLM Evaluation

  • Jack Fitzsimons

    Blatent

    CTO and Co-Founder

Open session

Ship Happens: Guardrails for AI-Written Code

  • Anthony Nguyen

    LaunchDarkly

    Senior Solutions Engineer

Open session

Decision models for developers who use LLMs

  • Anurag Bhandari

    antelligent

    CTO

Open session

Beware of Strangers Bearing Code: Open Source Trust in the Agent Era

  • Vikram Vaswani

    Consultant

Open session

Your AI Wrote the Code. Who Vouches for It?

  • Siddharth Joshi

    GitHub

    Senior Customer Success Architect

Open session

The Dream Team You Didn't Know You Had - Multi-Model, Multi-Agent, One Software Lifecycle

  • Aditya Dua

    GitHub

    Senior Manager, Field Services, SAARC

Related videos

Evals vs. Evil - AI and Package Security - Laurie Voss thumbnail
16:57

Evals vs. Evil - AI and Package Security

Laurie Voss

Coffee With Developers · Jul 2026

Beyond the Benchmark: How to Evaluate AI Agents in the Real World thumbnail
30:04

Beyond the Benchmark: How to Evaluate AI Agents in the Real World

Taylor Jordan Smith · Red Hat

World Congress Europe · 2026

Teaching an LLM to review code … like a Senior Engineer! thumbnail
32:26

Teaching an LLM to review code … like a Senior Engineer!

Kesha Mykhailov · Fin

World Congress Europe · 2026

Why LLMs Need Observability and How to Do It thumbnail
32:41

Why LLMs Need Observability and How to Do It

Rahul Gupta · Beroe

Europe Virtual · 2026

Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source thumbnail
29:50

Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source

Viktoria Semaan · databricks

World Congress Europe · 2026

Reinventing Testing Practices in the AI Era thumbnail
30:19

Reinventing Testing Practices in the AI Era

Eric Deandrea · IBM

World Congress North America · 2026

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.