News for hackers. Stuff that matters.
Re:Overcoming the Limits of Large Language Models by nl on Thursday July 18, 2024 @12:14AM (#40992460)
And we use "hallucination" because in the ancient times when generative AI meant image generation models would "hallucinate" extra fingers etc.

The behavior of text models is similar enough that the wording stuck, and it's not all that bad.

Re:Overcoming the Limits of Large Language Models by darby_nine on Friday July 19, 2024 @08:17AM (#41005615)
That was a misnomer—hallucination refers to perception, not generation. Completely misled an entire generation of people.
Re:Overcoming the Limits of Large Language Models by Raphaellll on Friday July 19, 2024 @11:49AM (#41007681)
"hallucination" was coined in the context of text generating RNNs. Specifically in this blog post by Karpathy in 2015: https://karpathy.github.io/2015/05/21/rnn-effectiveness/