News for hackers. Stuff that matters.
Re:Teach your LLM to answer with facts, not fiction by s1mon on Sunday July 23, 2023 @11:49PM (#36842931)
"Hallucination" makes it sound like ChatGPT drank some of the punch without realizing it was laced with LSD. "Bullshit" sounds more like what comes out of an overconfident ass who should or could know better with some better education.
Re:Teach your LLM to answer with facts, not fiction by delecti on Sunday July 23, 2023 @11:56PM (#36842969)
Hallucination is a better descriptor for what an LLM is doing though. A bullshitter knows they don't know, an LLM just strings words together in ways that fit what it "saw" from training data. IMO the main problem with calling them hallucinations is the implication that the true things they say are true on purpose. It's hallucinating the true things too.
Re:Teach your LLM to answer with facts, not fiction by mdp2021 on Monday July 24, 2023 @03:52AM (#36844371)
Exactly, but no, there should be no «implication that the true things they» output are not part of that: required modules for foundational thinking (let us say "critical thinking") are missing.

(Issue is, now some are convinced that people in general would do the same and just blurt out the feedforward output of their "internal neural network", as opposed to having built knowledge in a loop of critical evaluation.)

Re:Teach your LLM to answer with facts, not fiction by ImHereToVote on Monday July 24, 2023 @06:45AM (#36845718)
In Swedish the term for perception and misapprehension is the same word. Because it is the same thing.
Re:Teach your LLM to answer with facts, not fiction by rsynnott on Monday July 24, 2023 @08:10AM (#36846630)
_Both_ are an inappropriate degree of anthropomorphism IMO.
Re:Teach your LLM to answer with facts, not fiction by balnaphone on Monday July 24, 2023 @02:51AM (#36843924)
"Confabulation" is the correct and precise term that comports with the English language, rather than being jargon requiring a neologism.
Re:Teach your LLM to answer with facts, not fiction by mdp2021 on Monday July 24, 2023 @03:42AM (#36844287)
> "Confabulation"

And why would that be? "Hallucination" means "erratic wandering", implying one is lost - similarly to "delirium" (maetaphor using the plough) and "error". Part of the idea is that of "instead of witnessing the correct, reporting the false" - a very ancient, traditional idea, and akin to the concept of "intelligence" (intus-legere).

"Confabulation" means locutor and interlocutor are talking, exchanging narrations.

Re:Teach your LLM to answer with facts, not fiction by codetrotter on Monday July 24, 2023 @04:25AM (#36844578)
> In psychology, confabulation is a memory error defined as the production of fabricated, distorted, or misinterpreted memories about oneself or the world. It is generally associated with certain types of brain damage (especially aneurysm in the anterior communicating artery) or a specific subset of dementias.

https://en.wikipedia.org/wiki/Confabulation

Re:Teach your LLM to answer with facts, not fiction by mdp2021 on Monday July 24, 2023 @04:40AM (#36844690)
Interesting, I will check that more analytically as soon as I will be back at the console,

but I am not sure - provisionally - that it can be a good idea to relate strictly human neurology to ANNs, if based on phenomena as opposed to structural issues. You do not have issue when staying with natural language.