News for hackers. Stuff that matters.
Re:Harvard researchers find AI coding agents shifted the bot... by thom on Tuesday November 17, 2026 @06:45PM (#50539881)
I really think ‘shifted the bottleneck to code review’ is misleading. It’s bad code. They write bad code. Yes if you want to salvage it you do a lot of code review, but that’s only because you’ve set your process up to pick spaghetti off the wall against which it has been flung. You could easily just push it all live without review and then pretend the bottleneck is SRE time, or set fire to yourself and claim the bottleneck is emergency service response time. But the root cause is that it’s bad code.
Re:Harvard researchers find AI coding agents shifted the bot... by donkey_brains on Tuesday November 17, 2026 @07:12PM (#50540133)
That’s a good take. How do we fix that? My own thought is agents trained on good codebases only. Not sprawling enterprise legacy applications which have long ago spread beyond their original design patterns. What are your thoughts?
Re:Harvard researchers find AI coding agents shifted the bot... by thom on Tuesday November 17, 2026 @07:22PM (#50540222)
I think it’s very hard with the current fine tuning infrastructure available to LLMs. Just like a real team, what you want is to immerse a new member in the domain, understanding that the code is a model of the world that both nourishes and is nourished by the team as you grow together. You want to reach a point where each contributor is intimately aligned on what you’re trying to achieve, and why and how. At that point all your code reviews should be left shifted anyway. But I have not had success putting this in a bunch of markdown files. There is very little infrastructure available for you to, for example, pair with an LLM for a period of time before setting it loose, and we’ve all become too impatient (voluntarily or by compulsion) to value that anyway.
Re:Harvard researchers find AI coding agents shifted the bot... by skydhash on Tuesday November 17, 2026 @08:50PM (#50540873)
Software is always human scaled, then made to run at machine speed. Because the needs is ultimately human. And anything human does not change that much fundamentally. Physical laws are even more rigid.

A lot of AI practice fell flat because you can't point out the human needs in them. They powered by dreams and wishes and there nothing that ground them.

Re:Harvard researchers find AI coding agents shifted the bot... by equinumerous on Tuesday November 17, 2026 @09:49PM (#50541242)
I fundamentally think LLMs are the wrong technology for writing code. They can write code, but should they be? If they were just as good as humans, the term "AI slop" would not be so recognizable to software engineers - if there is such a thing as AI slop code, there is such a thing as code quality, and AI does not write a lot of quality code. Now, you can argue that quality code doesn't matter. But words have meaning, and quality usually means code is maintainable, usable, easily refactored (it's software, remember?), and correct. If AI can do all of this as well or better than humans, why is there so much push-back from software engineers against the wide-scale use of AI? One need not look further than many major open source projects to see that people don't want AI slop PRs; so if we really want to automate software engineering, our job is to figure out the delta between AI slop and good-enough code, and make the process of writing good-enough code repeatable.