News for hackers. Stuff that matters.
Re:Harvard researchers find AI coding agents shifted the bot... by lz400 on Tuesday November 17, 2026 @06:33PM (#50539755)
A lot of this university research on AI feels dated. This is something we all faced months ago. Many times they're also reaching conclusions using obsolete models, etc. Feels like things move too fast for traditional research cycles to catch up to AI dev
Re:Harvard researchers find AI coding agents shifted the bot... by thraway3837 on Tuesday November 17, 2026 @06:40PM (#50539827)
Exactly. What a weird clickbait title to come out of a Tier 1 institution. You have Harvard PhD's concluding this!? This is what a PhD at that insitution is putting out? That is really sad. FTA:

The paper’s interviews show what that looks like on a team: a junior software engineer described a project where only one senior engineer could approve changes and could review the interviewee’s code only once a week.

So the issue is not AI. The issue is organizations and certain personalities who think that a human is going to be a better coder than an engineer. At this point rolling and writing your own code is akin to making up your own encryption scheme.

Re:Harvard researchers find AI coding agents shifted the bot... by thraway3837 on Tuesday November 17, 2026 @06:53PM (#50539957)
Keep the downvotes coming. You really aren't proving anything I said as incorrect.
Re:Harvard researchers find AI coding agents shifted the bot... by cajal on Tuesday November 17, 2026 @08:02PM (#50540537)
you’re just being smug and anti intellectual for the sake of being smug

“this is obviously true because i feel like it is” does not mean things are actually true. things should be formally measured as real trends and not just vibes.

but you prefer to be smug lmao

Re:Harvard researchers find AI coding agents shifted the bot... by cajal on Tuesday November 17, 2026 @08:05PM (#50540555)
i’m so ready for this era of tech bros being convinced they know better than every other field to finally come to an end
Re:Harvard researchers find AI coding agents shifted the bot... by asveikau on Tuesday November 17, 2026 @09:42PM (#50541187)
You might be waiting a while. This has been the case for some time.
Re:Harvard researchers find AI coding agents shifted the bot... by taurath on Tuesday November 17, 2026 @06:49PM (#50539918)
Its not resolved though, by any measure, except by removing human code review and coherence at the code level. Which is a pretty big tradeoff that has some at this point well-known downsides.
Re:Harvard researchers find AI coding agents shifted the bot... by lz400 on Wednesday November 18, 2026 @02:06AM (#50542831)
I think that's the consensus. Reviews are not at the code / PR level anymore. It's all about creating an environment where you can trust the agents to review themselves and you keep the general architecture supervised and can zoom in when there's something you want more detail on.
Re:Harvard researchers find AI coding agents shifted the bot... by nl on Tuesday November 17, 2026 @08:42PM (#50540812)
I think you are way overestimating the speed of diffusion into non-SV companies.

I was sitting with someone the other day who worked at a major ecommerce/media company (outside the US). They had access to Opus 4.5 via Co-pilot.

Re:Harvard researchers find AI coding agents shifted the bot... by motionlessveloc on Tuesday November 17, 2026 @09:13PM (#50541016)
My partner's company positions themselves as "powered by AI" in their marketing.

Back in reality, this means they have a corporate subscription to Copilot, which she doesn't use.

Re:Harvard researchers find AI coding agents shifted the bot... by hetspookjee on Tuesday November 17, 2026 @09:45PM (#50541215)
Oof, that must be a hefty bill for that company. Any older tier model is prized multiples. Believe you see it with every provider.
Re:Harvard researchers find AI coding agents shifted the bot... by nl on Wednesday November 18, 2026 @01:27AM (#50542569)
To clarify, it was Github Co-pilot so was in their IDE - not a generic MS Co-pilot.

They limit all developer to $100/month (maybe it was $150) budget too.

Their "coding with AI" was prompts like "implement this function" where they write the function header.

It's actually shocking to see people still working like that.

Re:Harvard researchers find AI coding agents shifted the bot... by bubulux on Wednesday November 18, 2026 @08:35AM (#50546144)
I always find it fascinating to see this out in the wild. I work from coworking spaces, so I’m constantly around developers from companies of all sizes, and the difference is striking.

Some of us have moved away from IDEs and writing code entirely and work terminal-first, while others still use agents the way I did two years ago.

For example, I recently watched someone in an actual code file adding Python import statements by waiting for Copilot’s inline suggestion to kick in. It was such a bizarre thing to witness. That’s not because of the person (I don’t want to judge anyone’s way of working; if someone enjoys writing code, that’s fine by me). It’s because I remember doing exactly that years ago, and since then I’ve stopped writing code altogether.

I even remembered that I had built an extension back then, because Copilot folks never added a quick opt-out or silent mode to Copilot inline suggestions[1].

It’s strange how fast everything has changed.

[1]: https://marketplace.visualstudio.com/items?itemName=Bubulus....

Re:Harvard researchers find AI coding agents shifted the bot... by LunaSea on Wednesday November 18, 2026 @09:37AM (#50546824)
And profit lines have stayed pretty much stable in the last few years for most companies.
Re:Harvard researchers find AI coding agents shifted the bot... by joenot443 on Wednesday November 18, 2026 @06:30AM (#50544993)
Do you mean Opus 5.5 is priced cheaper than 4.5?

That's a bit rent-seeking on Anthropic's part, IMO.

Re:Harvard researchers find AI coding agents shifted the bot... by hetspookjee on Wednesday November 18, 2026 @08:57AM (#50546375)
Yes,and and OpenAI does it too. E.g. luna-5.6 being 2x as expensive as Luna-6. I get that it feels like rent-seeking from a consumer point of view, with the lense of how non-LLM workload services are offered in general. But in this case it's an actual model occupying VRAM to be able to provide low latency interactive prompts, which is rather expensive. The whole benefit of LLMs is pooling the users in a single one so the moment a new model comes along and you need to maintain v1 and v2 at the same time, it becomes significant.
Re:Harvard researchers find AI coding agents shifted the bot... by timr on Tuesday November 17, 2026 @08:52PM (#50540896)
Not that I think most academic research is worth the time consumed producing it, but it feels dated because it actually takes time to do research instead of just rapidly changing direction based on feels, which is what developers are currently doing.

In particular, code review is not solved. Pointing another error-prone bot at the output of your first error-prone bot, and then pressing "Enter" if the test suite passes, is not a solution.

Re:Harvard researchers find AI coding agents shifted the bot... by devindotcom on Tuesday November 17, 2026 @10:16PM (#50541423)
hard to know where to start here. but I think it is sufficient to say you seem to misunderstand the fundamental purpose and process of academic research and may wish to avoid commenting on it until you do.
Re:Harvard researchers find AI coding agents shifted the bot... by j45 on Tuesday November 17, 2026 @10:54PM (#50541666)
Agreed, by the time the study is done, they're studying the well established and past.

Of course for industries and corporate it might not be an issue.

Re:Harvard researchers find AI coding agents shifted the bot... by colordrops on Wednesday November 18, 2026 @12:35AM (#50542269)
I think the only thing that matters are:

* the code does what you want

* it has no security holes

* it's able to be updated in the future without breaking everything

if the code looks like spaghetti, it doesn't really matter anymore, because humans are editing it. The only one of those three that I'm not entirely comfortable with yet is the security issue, and I don't know how to resolve it without actually having a human audit the code. If we figure out how to ensure security of AI generated code, there will be no point to code review anymore.

Re:Harvard researchers find AI coding agents shifted the bot... by epihelix on Wednesday November 18, 2026 @03:06AM (#50543238)
> if the code looks like spaghetti, it doesn't really matter anymore

Genuinely curious -- are others here still seeing lots of spaghetti code from frontier models? It happens occasionally for me, but only when editing old hand-written code bases that honestly had a bit of spaghetti there already (you might say the model simply followed the house style ... :/ )

For new agentic coding projects, these is generally very nicely structured from the start and extend well, IME. Yes, sometimes it needs a refactor if the code is pushed well outside the bounds of its original scope -- but hand-tooled code will need that just the same.

Re:Harvard researchers find AI coding agents shifted the bot... by agos on Wednesday November 18, 2026 @04:36AM (#50544061)
I don't know about spaghetti, but overengineered code is a daily occurence
Re:Harvard researchers find AI coding agents shifted the bot... by epihelix on Wednesday November 18, 2026 @06:39AM (#50545068)
Yes, the models do love to do silly things like strict validation of internal function inputs. Harmless, but a little annoying. Model RL appears highly defensive, and it's probably better to be too strict than too lax.

But this, and other over-engineered code issues, can generally be solved at the system prompt/developer prompt/AGENTS.md level.

Re:Harvard researchers find AI coding agents shifted the bot... by Revanche1367 on Wednesday November 18, 2026 @02:11AM (#50542868)
That’s what academia tech studies are like. I’m working full time as a SWE while in grad school (not CS but closely related) and sat in a seminar with a world-renowned researcher as they went over their yet to be published study which included testing things against the new agentic models. That was a couple of months ago, the study used the “latest” models like ChatGPT 4.1. And they seemed quite amazed by its capabilities. Kind of funny to watch when you’re running Astra 6 for your daily driver.
Re:Harvard researchers find AI coding agents shifted the bot... by blks on Wednesday November 18, 2026 @02:36AM (#50542999)
What exactly changed in couple of months? You suddenly become faster at reviewing code? Or your company decided to abandon human review in favor of merging whatever an agent reviewed and approved?
Re:Harvard researchers find AI coding agents shifted the bot... by DragonStrength on Wednesday November 18, 2026 @04:36AM (#50544056)
[delayed]
Re:Harvard researchers find AI coding agents shifted the bot... by ccapitalK on Wednesday November 18, 2026 @08:30AM (#50546088)
It's important to have proper research by groups of professionals dedicated to carefully scrutinizing if an effect is real, even on things that seem very obvious. Every now and again, they show that some obvious things are actually false.
Re:Harvard researchers find AI coding agents shifted the bot... by bensyverson on Wednesday November 18, 2026 @09:49AM (#50546981)
“Harvard researchers find desktop printers shifted the bottleneck from typesetting to page layout”