News for hackers. Stuff that matters.
Re:Tool touted as 'first AI software engineer' is bad at its... by disambiguation on Saturday January 25, 2025 @08:20PM (#42826790)
>"Tasks that seemed straightforward often took days rather than hours, with Devin getting stuck in technical dead-ends or producing overly complex, unusable solutions," the researchers explain in their report. "Even more concerning was Devin’s tendency to press forward with tasks that weren’t actually possible."

Apparently we've all been working with Devin for years.

Re:Tool touted as 'first AI software engineer' is bad at its... by mullingitover on Saturday January 25, 2025 @10:07PM (#42827350)
> "Even more concerning was Devin’s tendency to press forward with tasks that weren’t actually possible."

Quickest way to get AI engineers kicked out of the company will be to patch them so they push back against unrealistic goals from management.

Seriously though, where is the AI C-suite? The AI BoD? At least with an AI BoD you don't have to worry about them doing backstabbing financial shenanigans for their own self-interest at the expense of the company.

Re:Tool touted as 'first AI software engineer' is bad at its... by xyzzy123 on Sunday January 26, 2025 @03:01AM (#42828555)
You would need much less "agreeable" AI to reliably steer a company. With current models an AI C-suite would quickly get "captured" by almost anyone interacting with it.
Re:Tool touted as 'first AI software engineer' is bad at its... by vrosas on Sunday January 26, 2025 @12:23PM (#42831758)
Like our president, whose policy stance is the stance of whoever he last talked to.
Re:Tool touted as 'first AI software engineer' is bad at its... by infomofo on Saturday January 25, 2025 @11:01PM (#42827597)
I feel like this whole thing is a PR campaign to make people empathize with AI.
Re:Tool touted as 'first AI software engineer' is bad at its... by raverbashing on Saturday January 25, 2025 @08:59PM (#42826985)
No kidding, this is noticeable even with the simpler platforms like chatgpt or copilot

It gives you an answer that looks fine but lacks important details etc

Re:Tool touted as 'first AI software engineer' is bad at its... by neilv on Saturday January 25, 2025 @11:11PM (#42827643)
If an employee behaved like an LLM, a company should immediately get them into a debriefing with corporate counsel, HR, management, and trusted top technical personnel.

For example, to try to find out whose IP they plagiarized, and how badly we're scrod.

Or, for example, to find out how they generated so much code they don't understand at all, and how badly we're scrod.

Or, for example, to find out why they wrote a criminally negligent security vulnerability or data corruption, and how badly we're scrod.

Or, for example, to see what engineering assurance they "hallucinated", and how badly we're scrod.

Re:Tool touted as 'first AI software engineer' is bad at its... by m463 on Saturday January 25, 2025 @08:28PM (#42826825)
sometimes working for him.
Re:Tool touted as 'first AI software engineer' is bad at its... by plagiarist on Saturday January 25, 2025 @08:37PM (#42826872)
"Well, of course I know him. He's me."