News for hackers. Stuff that matters.
Re:Detecting when LLMs are uncertain by botanical76 on Friday October 25, 2024 @03:40PM (#41948866)
What other word would you suggest?

I've seen "bullshitting" suggested, but this of course still implies intent, which AIs do not have in any typical sense of the word.

I think we as a community have settled on hallucination as the best English word that approximately conveys the idea. I've seen folks on here making up words to describe it, as if that is any more useful to the victim here. The victim being the uninformed (w.r.t AI tech) layperson.

Re:Detecting when LLMs are uncertain by atoav on Friday October 25, 2024 @03:47PM (#41948929)
LLMs give you a plausible chain of words, the word "hallucination" assumes intentionality that doesn't exist — as if the LLM had a "clear" state of mind and one where it felt a bit dizzy — but all of that does not describe what is going on.
Re:Detecting when LLMs are uncertain by CooCooCaCha on Friday October 25, 2024 @04:52PM (#41949638)
Hallucination does not imply intentionality, in fact the opposite.
Re:Detecting when LLMs are uncertain by atoav on Friday October 25, 2024 @04:57PM (#41949685)
which was my point.
Re:Detecting when LLMs are uncertain by CooCooCaCha on Friday October 25, 2024 @05:58PM (#41950229)
Your point is misusing a word? The word “hallucination” in no way implies intentionality.
Re:Detecting when LLMs are uncertain by atoav on Saturday October 26, 2024 @03:24AM (#41953173)
Granted maybe it was a bit unclear, so let me claify my point:

In humans hallucination is about a loss of a relationship with an underlying physical world. A physical world whose model we have in our heads and interact with in intentional ways if we are not hallucinating.

That means using the word hallucinating implies that the thing could also not be hallucinating and have a grip on reality. And rhis was my criticism, a LLM spits out plausible phrases, if the graph wouldn't consider an output plausible it wouldn't return it. That means for the LLM there is no difference between plausible bogus and a factually correct statement, this is something humans interpret into the output from the outside.

Re:Detecting when LLMs are uncertain by haccount on Friday October 25, 2024 @05:07PM (#41949786)
The word confabulation is used in situations where human beings unintentionally pad whatever they say with falsehoods.
Re:Detecting when LLMs are uncertain by joe_the_user on Friday October 25, 2024 @07:19PM (#41950903)
The thing about "hallucination" (or confabulation or anything describing having false ideas) is that it captures the LLM behavior of not just making a statement but "standing behind it", making a continuing argument for their (false) idea when questioned.

Human do this too, of course. The LLMs are simply emulating this human behavior.

Re:Detecting when LLMs are uncertain by codetrotter on Friday October 25, 2024 @03:45PM (#41948911)
“Confabulations” is sometimes mentioned as an alternative to “hallucinations”.

It’s a better alternative than “bullshitting”, because “confabulating” does not have that kind of connotation of intent.

Re:Detecting when LLMs are uncertain by paulddraper on Friday October 25, 2024 @04:42PM (#41949503)
Hallucinating is descriptive but superlative.

Wrong or inaccurate are alternatives.

Re:Detecting when LLMs are uncertain by Semiapies on Friday October 25, 2024 @08:42PM (#41951537)
Illusion. Mirage.