News for hackers. Stuff that matters.
Re:AI Hallucinations: Why Large Language Models Make Things ... by zmgsabst on Wednesday December 04, 2024 @08:01PM (#42323760)
A challenge is that it’s not easy to limit hallucinations without also limiting imagination and synthesis.

In humans.

But also apparently in LLMs.

Re:AI Hallucinations: Why Large Language Models Make Things ... by namaria on Thursday December 05, 2024 @03:05AM (#42326021)
> A challenge is that it’s not easy to limit hallucinations without also limiting imagination and synthesis.

> In humans.

True, but distinguishing reality from imagination is a cornerstone of mental health. And it's becoming apparent that the average person will take the confident spurious affirmations of LLMs as facts, which should call their mental health into question.

Re:AI Hallucinations: Why Large Language Models Make Things ... by zmgsabst on Thursday December 05, 2024 @10:14AM (#42328970)
Misremembering facts isn’t a negative mental health event, yet is an example of imagination rather than recall — similar to LLMs hallucinating.

Humans imagine events all the time, without the ability to know that happened. Part of why eye-witness testimony is so unreliable.

Re:AI Hallucinations: Why Large Language Models Make Things ... by mort96 on Thursday December 05, 2024 @03:40AM (#42326205)
Healthy humans generally have some internal model of the world against which they can judge what they're about to say. They can introspect and determine whether what they say is a guess or a statement of fact. LLMs can't.
Re:AI Hallucinations: Why Large Language Models Make Things ... by zmgsabst on Thursday December 05, 2024 @10:13AM (#42328959)
Humans routinely misremember facts but are relatively certain those remembrances are correct.

That’s a form of minor, everyday hallucination.

If you engage in such thorough criticism and checking of every recalled fact as to eliminate that, you’ll crush your ability to synthesize or compose new content.

Re:AI Hallucinations: Why Large Language Models Make Things ... by mort96 on Thursday December 05, 2024 @11:38AM (#42329747)
No, that's not hallucination.

In a human, there is a distinction between "this is information I truly think I know, my intention is to state a true fact about the world" and "this is something I don't know so I made something up". That distinction doesn't exist in LLMs. The fact that humans can be mistaken is a completely different issue.

Re:AI Hallucinations: Why Large Language Models Make Things ... by mdp2021 on Thursday December 05, 2024 @02:12PM (#42331493)
> If you engage in such thorough criticism and checking of every recalled fact as to eliminate that, you’ll

Experience tells us differently: creativity is not impacted. In fact, it will probably return better solutions (as opposed to delirious).

Re:AI Hallucinations: Why Large Language Models Make Things ... by mdp2021 on Thursday December 05, 2024 @04:13AM (#42326401)
On office desks there were "In" boxes and "Out" boxes. You do not put "imagination" in "Out" boxes. What is put in "Out" boxes must be checked and stamped.

"Imagination" stays on the desk. You "imagine" that a plane could have eight wings, then you check if it is a good idea, and only then the output is decided.