News for hackers. Stuff that matters.
Re:Harvard researchers find AI coding agents shifted the bot... by vjvjvjvjghv on Tuesday November 17, 2026 @10:47PM (#50541617)
[delayed]
Re:Harvard researchers find AI coding agents shifted the bot... by skydhash on Wednesday November 18, 2026 @12:11AM (#50542136)
> I have no idea how the Linux maintainers do that job over a long time.

They're basically the lords of their subsystems. If something does not fit the project's vision and their own standard, it's unlikely to get merged. Imagine if you had the authority to dismiss PRs the same way and send the author back to the drawing board? But that's unlikely to happen as you'll be seen as a "bottleneck" by your managers.

Re:Harvard researchers find AI coding agents shifted the bot... by Antoniocl on Wednesday November 18, 2026 @12:22AM (#50542188)
If you feel the need to send the author all the way back to the drawing board at the code review stage for any non-trivially large diff, I'd venture that the problem lies in the architecture design / project planning stage. Given you're already aligned on infrastructure, table design, and interfaces, (and company conventions like language, style, etc) how significantly can you diverge in implementation details? Can it really vary so greatly that you need to go all the way back to the drawing board?
Re:Harvard researchers find AI coding agents shifted the bot... by skydhash on Wednesday November 18, 2026 @12:52AM (#50542358)
> Given you're already aligned on infrastructure, table design, and interfaces, (and company conventions like language, style, etc) how significantly can you diverge in implementation details? Can it really vary so greatly that you need to go all the way back to the drawing board?

It can because to actually write the code, you need to be good at formal logic and attuned to the sequential nature of the machine. Some people are good at it intuitively. Some brings it over from some other domain. But some people have a lot of difficulty grasping such abstraction. They know the elements, they just can't order them in a logical manner. That's why you often see horrible code (the long function, the god class, magic number) and copy-pasted snippets all over the place. The computer don't care (they made it work somehow), but it's unmaintainable code.

Re:Harvard researchers find AI coding agents shifted the bot... by pmg101 on Wednesday November 18, 2026 @02:22AM (#50542920)
But does AI tend to write code like this?

I tend to find it does not. Partly steered by by agents.md, partly by the surrounding context of a clean codebase I suppose.

Re:Harvard researchers find AI coding agents shifted the bot... by skydhash on Wednesday November 18, 2026 @07:09AM (#50545323)
It doesn’t, but what I found is that those people can’t steer it to simpler solution or can’t point out the inaccuracies. They get blinded by the appearance of the code (which does look like someone good has written it) and they submit everything as is. And because the tool does ingest the same code, it can converge to some pretty nonsensical codebase.

I think that why everyone agrees that taste matters. Because taste implies judgement and knowledge about what’s good. It’s a self correcting mechanism. But people that won’t judge their output and/or don’t strive to do a good job is a recipe for sloppy work.

Re:Harvard researchers find AI coding agents shifted the bot... by rypskar on Wednesday November 18, 2026 @02:00AM (#50542796)
>> I'd venture that the problem lies in the architecture design / project planning stage

I would guess you work for a larger company. My experience is more that someone had an idea or got a short description of a problem and then went off and asked Claude to help write the spec before letting Claude implement that spec. The code is starting to be good but often it is way to much code and some times for bugs it is fixing the symptom not the underlying problem. I have several times rejected PRs with, this isn't fixing the actual problem or instead of these 400 lines you could change that one parameter to the existing function and get a better result.

/end rant and back to another day with code review of AI code

Re:Harvard researchers find AI coding agents shifted the bot... by alkonaut on Wednesday November 18, 2026 @03:58AM (#50543732)
I find this much easier now though. Five years ago if a Colleague sent me a large PR they had worked N days on, I'd be very reluctant to say "Ok this should be done the opposite way, but I guess it's too late for that now".

The acceptance for wasting work, or hurting someone's ego was always much lower than the acceptance for bad code that does the job right.

Now I can just say "Let's try doing this in two other ways, and pick the best, because this has such and such drawbacks". And it's so nice that this isn't a) causing a massive amount of extra work b) hurting someone's ego. So it's accepted.

So that's why I'm cautiously optimistic that LLMs and very superficial reviews can still be beneficial to quality. We just didn't reject/rewrite PRs before, now we do.

Re:Harvard researchers find AI coding agents shifted the bot... by otabdeveloper4 on Wednesday November 18, 2026 @02:24AM (#50542932)
> slowly go off the rails

We're talking months here, not years. That isn't "slowly".

Re:Harvard researchers find AI coding agents shifted the bot... by frevib on Wednesday November 18, 2026 @02:44AM (#50543052)
Nobody understands the code any more. LLMs always take the long route. This is exactly what Dario wants. You can now only change code with an LLM.

> And the better the AI code gets

It doesn’t really get better. Since Opus 4.6, it’s maybe slightly better for code.

Re:Harvard researchers find AI coding agents shifted the bot... by civvv on Wednesday November 18, 2026 @03:49AM (#50543656)
Yeah their coding ability has really not increased much since 4.6. I specifically remember 4.6 being a step up from the previous iterations, but since that not much has happened. I recently went back to 4.6 our of curiosity and to my surprise I sometimes prefer the output of it. Much less verbose.
Re:Harvard researchers find AI coding agents shifted the bot... by lordnacho on Wednesday November 18, 2026 @04:37AM (#50544067)
Somehow I've felt the same. Around 4.6 or so, there's a plateau where the model is smart enough to get a working answer, and it's within reasonable taste whether you think one version or another is better.

But getting there was a frightening ride. My experience went from "copilot can't do more than tab-completing a few lines" to "early codex gives up and apologizes on mid sized changes" to "Claude can write your entire project without getting stuck".

Re:Harvard researchers find AI coding agents shifted the bot... by frevib on Wednesday November 18, 2026 @05:09AM (#50544306)
We’re using 4.8. Much less chatty and less assumptions. > 5.0 is taking too many decisions itself.
Re:Harvard researchers find AI coding agents shifted the bot... by jpardoe on Wednesday November 18, 2026 @04:08AM (#50543821)
I do shallow reviews and it's working out fine. As long as I understand the schema and type changes and can glance at any new abstractions (rarely is any with my set up) then that tells me 80% of what I need to know in minutes. What, am I going to comb through everything for bugs? That's just not necessary anymore, agents will catch just as many bugs (actually many more).
Re:Harvard researchers find AI coding agents shifted the bot... by jijijijij on Wednesday November 18, 2026 @04:32AM (#50544018)