News for hackers. Stuff that matters.
Re:Does current AI represent a dead end? by cs702 on Friday December 27, 2024 @11:37AM (#42523575)
No, it doesn't "solve" the unpredictability problem.

But we haven't solved it for human beings either.

Human brains are unpredictable. Look around you.

Re:Does current AI represent a dead end? by timeon on Friday December 27, 2024 @11:44AM (#42523644)
How are humans relevant here? As example, we operate at different speed.
Re:Does current AI represent a dead end? by cs702 on Friday December 27, 2024 @11:50AM (#42523706)
Humankind has developed all sorts of systems and processes to cope with the unpredictability of human beings: legal systems, organizational structures, separate branches of government, courts of law, police and military forces, double-entry bookkeeping, auditing, security systems, anti-malware software, etc.

While individuals do trust some of the people they know, in the aggregate society doesn't seem to trust human beings to behave reliably.

It's possible, though I don't know for sure, that we're going to need systems and processes to cope with the unpredictability of AI systems.

Re:Does current AI represent a dead end? by mrweasel on Friday December 27, 2024 @12:03PM (#42523846)
Are you expecting AIs to be more reliable, because they're slower?
Re:Does current AI represent a dead end? by uoaei on Friday December 27, 2024 @12:31PM (#42524115)
Human performance, broadly speaking, is the benchmark being targeted by those training AI models. Humans are part of the conversation since that's the only kind of intelligence these folks can conceive of.
Re:Does current AI represent a dead end? by sdesol on Friday December 27, 2024 @01:12PM (#42524507)
> Human brains are unpredictable. Look around you.

As it was mentioned by others, we've had thousands of years to better understand how humans can fail. LLMs are black boxes and it never ceases to amaze me how they can fail in such unpredictable ways. Take the following for examples.

Here GPT-4o mini is asked to calculate 2+3+5

https://beta.gitsense.com/?chat=8707acda-e6d4-4f69-9c09-2cff...

It gets the answer correct, but if you ask it to verify its own answer

https://beta.gitsense.com/?chat=6d8af370-1ae6-4a36-961d-2902...

it says the response was wrong, and contradicts itself. Now if you ask it to compare all the responses

https://beta.gitsense.com/?chat=1c162c40-47ea-419d-af7a-a30a...

it correctly identifies that GPT-4o mini was incorrect.

It is this unpredictable nature that makes LLM insanely powerful and scary.

Note: The chat on the beta site doesn't work.