News for hackers. Stuff that matters.
Re:GPTs and Hallucination by radarsat1 on Tuesday September 10, 2024 @04:35PM (#41505221)
I think this may be the best explanation I've seen on the topic!

But, shouldn't that situation be handled somewhat by backtracking sampling techniques like beam search? But maybe that is not used much in practice due to being more expensive.. don't know.

Re:GPTs and Hallucination by HarHarVeryFunny on Tuesday September 10, 2024 @06:58PM (#41506473)
Thanks!

I'm not sure if beam search would help much since it's just based on combining word probabilities as opposed to overall meaning, but something like "tree of thoughts" presumably would since I doubt these models would rate their own hallucinated outputs too highly!