News for hackers. Stuff that matters.
Re:Harvard researchers find AI coding agents shifted the bot... by Buttons840 on Tuesday November 17, 2026 @10:47PM (#50541615)
Neither one of these replies seems to have the least understanding of what I said.

I'm saying we need to move away from "LGTM" focused PR reviews. Most companies have a PR review focused on getting thumbs-up emojis in the comment, then they merge and have a sprint planning. Nobody ever reviews the entire system. Nobody ever asks "assuming there is a mistake in this PR, would it matter? How can we make it so that it wouldn't matter?"

I never claimed AI makes no mistakes. People makes mistakes, and reviewers make mistakes too.

I've worked at a lot of mediocre companies where the plan to keep the system working is "the developer will not make a mistake, and the code reviewer will not make a mistake, this is our plan, our plan is humans will not make mistakes, and then our system will continue working".

It's better to ask "let's assume a human (or an AI) does make a mistake, how can we design the system to prevent that from mattering?"

Most companies don't have the capacity to do that though, so they never move beyond thumbs-up emojis.

Re:Harvard researchers find AI coding agents shifted the bot... by Madmallard on Tuesday November 17, 2026 @10:58PM (#50541701)
"how can we design the system to prevent that from mattering"

you can't

there is no way around it

we need far more review than we economically are motivated to sustain

and hence issues like we've been having over the past week will continue and perhaps worsen

software will (as it already has been) get crappier and crappier overtime

Re:Harvard researchers find AI coding agents shifted the bot... by Buttons840 on Tuesday November 17, 2026 @11:13PM (#50541786)
I can alter the JavaScript that HN sends me and add all sorts of mistakes to it. My computer will then execute JavaScript that contains mistakes, will that matter?
Re:Harvard researchers find AI coding agents shifted the bot... by Madmallard on Tuesday November 17, 2026 @11:24PM (#50541856)
I'm saying it's an economic issue and snakes ruining late-stage capitalism problem more than anything else

Humans can be ultra competent if people are actually paying them to be artisans or otherwise motivating them to truly be that way. That's how we have some of the architecture we have today and historically.

Re:Harvard researchers find AI coding agents shifted the bot... by intended on Wednesday November 18, 2026 @12:15AM (#50542146)
The error in the position is that your definition of mediocre was grounded in the pre AI era. You are then applying failure to do review properly as a standard to identify mediocre firms, and now all firms are mediocre.

This is a No True Scotsman argument.

The prescription you suggest is not dependent on its inspiration, so it can still be discussed.

All firms right now, even those with better than average cultures, are dealing with AI code workflows.

Previously the volume of code generated over time was lower, even mediocre code review was useful enough over all the code that people generated.

Today, the ratio of verification capacity to generation capacity has shifted drastically. Even with automated tooling, the amount of verification isn’t enough to stay on top of the generated code.

This changes only when leadership values reviewer capacity, or builds a triage/priority list for code which must be understood.

Re:Harvard researchers find AI coding agents shifted the bot... by kgeist on Tuesday November 17, 2026 @11:29PM (#50541889)
Agree, many people think code reviews are there to catch "mistakes" (I used to think so too) but I think in most cases, they don't work that way. Bugs are still shipped and, at least in my experience, most reviewers often just quickly skim the changes without paying attention to the details. And those code reviews only give false confidence that a change is OK and must be error-free and good to go just because it was given LGTM by a senior dev (who barely looked at it), with all the consequences of such false confidence. It feels like in 95% of cases review is not even necessary and is just a corporate ritual at this point. It makes sense when you have a fresh contributor and you don't have confidence in them yet (i.e. code review as an onboarding process) or when a certain feature is non-trivial and you aren't sure everyone will be on the same page about the architecture (to prevent future conflicts/disagreements/rewrites of sorts), but other than that, proper QA processes are more important and more effective than CR at catching mistakes (tests, canaries etc.). Our company used to have a strong PR culture but now for a few years, there've been talks that CR is a bottleneck which doesn't really solve the problems it's supposed to solve. My current pipeline with AI-generated code (and my own code too) is that I run AI reviewers several times on a single PR (the way LLMs work, due to attention optimizations, quantization issues, token sampling issues, harness issues -- AI agents often overlook some things on the first attempt), then I assemble the final report and we quickly decide together what needs to be addressed (critical stuff) and what's okay as is. I quickly skim the change set myself too, to see what the shape of the tests is, and what code areas were touched, just to be informed, and that's about it. I don't feel exhausted personally, because it pays off when there's a working feature at the end of the day
Re:Harvard researchers find AI coding agents shifted the bot... by talmr on Wednesday November 18, 2026 @01:39AM (#50542651)
Code review exists as both a scapegoat mechanism and due diligence.
Re:Harvard researchers find AI coding agents shifted the bot... by intended on Wednesday November 18, 2026 @12:06AM (#50542113)
While the start of your argument is compelling, I think this statement has no place in this context and reduces the credibility of everything else:

> I never claimed AI makes no mistakes. People make mistakes, and reviewers make mistakes too.

These are 2 separate things. The crux of the issue is the push towards utility over understanding. The volume of generated code means that it is impossible for understanding about the system to be achieved - and it is now the universal coding experience, not just mediocre firms.

Quantity is its own quality, as well so even a good culture will struggle to stay on top of review.

Re:Harvard researchers find AI coding agents shifted the bot... by jbwinters on Wednesday November 18, 2026 @12:19AM (#50542170)
"Assuming there is a mistake in this PR, would it matter? How can we make it so that it wouldn't matter?" is what I was going for with https://jacquardlang.org/.

Each function declares what it can touch (e.g. network, filesystem, clock) and the compiler and runtime work together to enforce it. However, I have yet to show it beats LLM-written Python plus tests and a sandbox. Models have gotten good enough at writing code that I haven't found much room for enforcement to help.

Re:Harvard researchers find AI coding agents shifted the bot... by goosejuice on Wednesday November 18, 2026 @08:58AM (#50546396)
[delayed]