WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2025 • Aug 20, 2025 • Session details

Evaluating AI models for code comprehension

Merrill Lutsky

Are noisy AI code reviews eroding your engineers' trust? Discover the evaluation strategies that prove why Claude 3.7 Sonnet outperforms Gemini and GPT-4o for automated pull requests.

Starting at 0:04 · Watch from the beginning

Evaluating AI models for code comprehension thumbnail

Checking access…

Playback and chapters load privately for Free videos.

Matching moments

1:56 min

Introduction to evaluating AI code review agents

Sofia Rest Sofia Rest · World Congress 2026 North America

2:02 min

Reimagining code reviews in the era of AI

Christian Heilmann Christian Heilmann +1 · World Congress 2026 North America

2:40 min

Reviewing live performance of self-correcting AI engineering agents

Ingo Eichhorst Ingo Eichhorst · World Congress 2026 Europe

3:01 min

Balancing artificial intelligence tools with foundational software engineering skills

Tim Ruscica · Coffee With Developers

3:22 min

Evaluating advanced artificial intelligence platforms for daily recruitment

Rudi Bauer Rudi Bauer +1 · Cappuccino with HR

1:56 min

Analyzing cloud-based AI code completion architectures

Daniel Savenkov Daniel Savenkov · World Congress 2024

More from World Congress 2025

GenAI Security: Navigating the Unseen Iceberg thumbnail
24:33

GenAI Security: Navigating the Unseen Iceberg

Maish Saidel-Keesing · AWS

Behind the Code: How Women Are Powering the Future of AI thumbnail
30:28

Behind the Code: How Women Are Powering the Future of AI

Alexandra Wudel +2

The AI Hype Filter: What’s Real, What’s Investable, What’s Noise? thumbnail
28:12

The AI Hype Filter: What’s Real, What’s Investable, What’s Noise?

Justus Lumpe +3

AI in Leadership: How Technology is Reshaping Executive Roles thumbnail
28:19

AI in Leadership: How Technology is Reshaping Executive Roles

Bernd Datler +3

The AI-Ready Stack: Rethinking the Engineering Org of the Future thumbnail
28:09

The AI-Ready Stack: Rethinking the Engineering Org of the Future

Alex Laubscher +3

AI Sovereignty: What Does It Take? thumbnail
29:13

AI Sovereignty: What Does It Take?

Boris Hecker +3

Upcoming sessions on this topic

Open session

Teaching AI Coding Agents to Build It Right the First Time

  • Sajeetharan Sinnathurai

    Microsoft

    Principal Product Manager

Open session

The 200,000 line code repository: My AI wrote 1000 lines. I needed 100.

  • Hardik Gupta

    IBM

    Software Developer

Open session

Did the Model Improve, or Just the Score? A Developer’s Guide to LLM Evaluation

  • Jack Fitzsimons

    Blatent

    CTO and Co-Founder

Open session

Thinking in Graphs, Reasoning with Gemini!

  • Bhavesh Bhatt

    N/A

    Lead AI Engineer

Open session

The Dream Team You Didn't Know You Had - Multi-Model, Multi-Agent, One Software Lifecycle

  • Aditya Dua

    GitHub

    Senior Manager, Field Services, SAARC

Open session

Beyond File Dumps: Context Engineering for Coding Agents

  • Animesh Dutta

    Arm

    Senior Software Engineer

Related videos

The Death of the Code Review thumbnail
32:34

The Death of the Code Review

Laurie Voss · Arize AI

World Congress North America · 2026

The Limits of Prompting: ArchitectingTrustworthy Coding Agents thumbnail
24:05

The Limits of Prompting: ArchitectingTrustworthy Coding Agents

Nimrod Kor · Baz

World Congress · 2025

How we built an AI-powered code reviewer in 80 hours thumbnail
28:07

How we built an AI-powered code reviewer in 80 hours

Yan Cui · Lumigo

World Congress · 2025

Livecoding with AI thumbnail
31:39

Livecoding with AI

Rainer Stropek · software architects

World Congress · 2024

Teaching an LLM to review code … like a Senior Engineer! thumbnail
32:26

Teaching an LLM to review code … like a Senior Engineer!

Kesha Mykhailov · Fin

World Congress Europe · 2026

Developer Productivity Using AI Tools and Services - Ryan J Salva thumbnail
59:16

Developer Productivity Using AI Tools and Services

Ryan J Salva

Coffee With Developers · May 2025

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.