News for hackers. Stuff that matters.
Re:OSWorld: Benchmarking Multimodal Agents for Open-Ended Ta... by ec109685 on Sunday April 28, 2024 @09:59PM (#40193638)
This is a thoughtful article on the current limitations of LLM and agents: https://www.strangeloopcanon.com/p/what-can-llms-never-do

A good example is that you can teach a first grader how to play wordle, but an LLM can’t be taught.

That’s a pretty big gap to a situation where most humans can be replaced.

Re:OSWorld: Benchmarking Multimodal Agents for Open-Ended Ta... by mhuffman on Sunday April 28, 2024 @10:04PM (#40193664)
Except that the problems most (and by that I mean non-software, non-billion-dollar) businesses have are not wordle type puzzle problems. They are 'go through all of our invoices and put xxxx data in a spreadsheet for me please' type problems or 'copy the data from this app and put it in that app' type problems or responding to emails or responding to simple customer support questions. And these are definitely in the wheelhouse of LLM near-future capabilities.
Re:OSWorld: Benchmarking Multimodal Agents for Open-Ended Ta... by bitwize on Sunday April 28, 2024 @10:21PM (#40193748)
And the human performers of many of these tasks have been replaced not by AIs but by VBA scripts. It's almost a trope that many Hackernews' first jobs were something of this type, and on the first day they wrote a VBA script to do most or all of it and then collected pay for, effectively, playing Minesweeper all day.
Re:OSWorld: Benchmarking Multimodal Agents for Open-Ended Ta... by mhuffman on Sunday April 28, 2024 @10:39PM (#40193831)
This is true, and how I got into software development as a job, but going forward they will likely be replaced by AI agents off of some site like Zapier.