News for hackers. Stuff that matters.
Re:The 'white-collar bloodbath' is all part of the AI hype m... by directevolve on Saturday May 31, 2025 @01:59AM (#44142166)
We’re already heading toward the sigmoid plateau. The GPT 3 to 4 shift was massive. Nothing since had touched that. I could easily go back to the models I was using 1-2 years ago with little impact on my work.

I don’t use RAG, and have no doubt the infrastructure for integrating AI into a large codebase has improved. But the base model powering the whole operation seems stuck.

Re:The 'white-collar bloodbath' is all part of the AI hype m... by threeseed on Saturday May 31, 2025 @02:17AM (#44142232)
> I don’t use RAG, and have no doubt the infrastructure for integrating AI into a large codebase has improved

It really hasn't.

The problem is that a GenAI system needs to not only understand the large codebase but also the latest stable version of every transitive dependency it depends on. Which is typically in the order of hundreds or thousands.

Having it build a component with 10 year old, deprecated, CVE-riddled libraries is of limited use especially when libraries tend to be upgraded in interconnected waves. And so that component will likely not even work anyway.

I was assured that MCP was going to solve all of this but nope.

Re:The 'white-collar bloodbath' is all part of the AI hype m... by HumanOstrich on Saturday May 31, 2025 @03:12AM (#44142509)
How did you think MCP was going to solve the issue of a large number of outdated dependencies?
Re:The 'white-collar bloodbath' is all part of the AI hype m... by threeseed on Saturday May 31, 2025 @03:41AM (#44142666)
Those large number of outdated dependencies are in the LLM "index" which can't be rapidly refreshed because of the training costs.

MCP would allow it to instead get this information at run-time from language servers, dependency repositories etc. But it hasn't proven to be effective.

Re:The 'white-collar bloodbath' is all part of the AI hype m... by chrsw on Saturday May 31, 2025 @10:31AM (#44144525)
> I could easily go back to the models I was using 1-2 years ago with little impact on my work.

I can't. GPT-4 was useless for me for software development. Claude 4 is not.

Re:The 'white-collar bloodbath' is all part of the AI hype m... by directevolve on Saturday May 31, 2025 @12:41PM (#44145415)
Interesting, what type of dev work do you do? Performance does vary widely across languages and domains.
Re:The 'white-collar bloodbath' is all part of the AI hype m... by chrsw on Saturday May 31, 2025 @01:07PM (#44145600)
Embedded software for robotics.