State of the Software Factory

While the “do you have to read the code” debate rages on, we’ve been hard at work figuring out how to get models to write code that gets better over time, not worse. We’ll discuss why current model training approaches and benchmarks checking “do the tests pass” are not enough, and how we’re approaching evaluating the long-term-quality of LLM-generated code.