Re:Overcoming the Limits of Large Language Models
by darby_nine on Friday July 19, 2024 @08:17AM
(#41005615)
That was a misnomer—hallucination refers to perception, not generation. Completely misled an entire generation of people.
Re:Overcoming the Limits of Large Language Models
by Raphaellll on Friday July 19, 2024 @11:49AM
(#41007681)
"hallucination" was coined in the context of text generating RNNs. Specifically in this blog post by Karpathy in 2015:
https://karpathy.github.io/2015/05/21/rnn-effectiveness/
The behavior of text models is similar enough that the wording stuck, and it's not all that bad.