News for hackers. Stuff that matters.
Re:Adversarial Policies Beat Superhuman Go AIs by kachapopopow on Tuesday December 24, 2024 @10:08AM (#42502358)
I honestly see hallucinations as an absolute win, it's attempting to (predict/'reason') information from the training data it has.
Re:Adversarial Policies Beat Superhuman Go AIs by zdragnar on Tuesday December 24, 2024 @10:57AM (#42502718)
I think this is a misuse of the term hallucination.

When most people talk about AI hallucinating, they're referring to output which violates some desired constraints.

In the context of chess, this would be making an invalid move, or upgrading a knight to a queen.

In other contexts, some real examples are fabricating court cases and legal precedent (several lawyers have gotten in trouble here), or a grocery store recipe generator recommending mixing bleach and ammonia for a delightful cocktail.

None of these hallucinations are an attempt to reason about anything. This is why some people oppose using the term hallucination- it is an anthropomorphizing term that gives too much credit to the AI.

We can tighten the band of errors with more data or compute efficiency or power, but in the search for generic AI, this is a dead end.

Re:Adversarial Policies Beat Superhuman Go AIs by wat10000 on Tuesday December 24, 2024 @11:28AM (#42502924)
It’s weird because there’s no real difference between “hallucinations” and other output.

LLMs are prediction engines. Given the text so far, what’s most likely to come next? In that context, there’s very little difference between citing a real court case and citing something that sounds like a real court case.

The weird thing is that they’re capable of producing any useful output at all.

Re:Adversarial Policies Beat Superhuman Go AIs by voidfunc on Tuesday December 24, 2024 @10:24AM (#42502466)
I don't think I see them as a win, but they're easily dealt with. AI will need analysts at the latter stage to evaluate the outputs but that will be a relatively short-lived problem.
Re:Adversarial Policies Beat Superhuman Go AIs by bubaumba on Tuesday December 24, 2024 @10:35AM (#42502548)
> I don't think I see them as a win

Unavoidable, probably

> but they're easily dealt with. AI will need analysts at the latter stage to evaluate the outputs but that will be a relatively short-lived problem

That solves only to some degree. Hallucinations may happen at this stage too. Then either correct answer can get rejected or false pass through.