Yan Cui
How we built an AI-powered code reviewer in 80 hours
#1about 2 minutes
An overview of an AI-powered code reviewer
The tool reviews pull requests, leaves inline comments, and provides a dashboard, with the talk focusing on lessons learned from building it.
#2about 3 minutes
The high-level serverless architecture for the application
The system uses GitHub webhooks, EventBridge, Lambda, Amazon Bedrock, and DynamoDB, with Clerk for auth and Stripe for payments.
#3about 4 minutes
Choosing Amazon Bedrock for security and privacy
Amazon Bedrock was selected for its strong security guarantees, data privacy policies, and serverless, token-based pricing model suitable for sensitive customer code.
#4about 5 minutes
The truth about LLM context window size and reasoning
Large context window sizes are misleading because a model's ability to reason over content collapses long before the advertised limit, forcing a one-prompt-per-file strategy.
#5about 3 minutes
Managing API rate limits and model availability
To overcome low default API rate limits, strategies include requesting limit increases, using cross-region inference, and implementing fallbacks to other models for reliability.
#6about 3 minutes
Strategies for controlling high LLM costs
The most effective cost control measure is to analyze only the changed lines in a pull request rather than the entire file, which also improves user experience.
#7about 4 minutes
Handling timeouts with durable execution in Lambda
A lightweight durable execution mechanism using checkpoints in DynamoDB prevents reprocessing files on Lambda retries, which are common due to slow LLM response times.
#8about 4 minutes
Dealing with different types of LLM hallucinations
Hallucinations range from simple invalid JSON to complex errors like suggesting fixes for outdated libraries, which can be mitigated with RAG but at a significant cost.
Related jobs
Jobs that call for the skills explored in this talk.
Featured Partners
Related Videos
24:05The Limits of Prompting: ArchitectingTrustworthy Coding Agents
Nimrod Kor
31:39Livecoding with AI
Rainer Stropek
26:30Three years of putting LLMs into Software - Lessons learned
Simon A.T. Jiménez
04:17Leapter: The Reinvention of Software Development? A Future Built On AI Generated Code.
Robert Werner
25:17AI: Superhero or Supervillain? How and Why with Scott Hanselman
Scott Hanselman
22:03Evaluating AI models for code comprehension
Merrill Lutsky
47:35Panel discussion: Developing in an AI world - are we all demoted to reviewers? WeAreDevelopers WebDev & AI Day March2025
Laurie Voss, Rey Bango, Hannah Foxwell, Rizel Scarlett, Thomas Steiner
32:26Bringing the power of AI to your application.
Krzysztof Cieślak
From learning to earning
Jobs that call for the skills explored in this talk.
Senior Backend Engineer – AI Integration (m/w/x)
chatlyn GmbH
Vienna, Austria
Senior
JavaScript
AI-assisted coding tools
Machine Learning Scientist (AI for Code)
SonarSource
Bochum, Germany
Java
Python
PyTorch
TensorFlow
Machine Learning
+1
AI/ML Team Lead - Generative AI (LLMs, AWS)
Provectus
Canton de Saint-Mihiel, France
Remote
€96K
Senior
Python
PyTorch
TensorFlow
+4