News for hackers. Stuff that matters.
Re:Why Language Models Hallucinate by vrighter on Saturday September 06, 2025 @11:36PM (#45155176)
if you insist that they are different, then please find one logical, non-subjective, way to distinguish between a hallucination and not-a-hallucination. Looking at the output and deciding "this is clearly wrong" does not count. No vibes.
Re:Why Language Models Hallucinate by esafak on Saturday September 06, 2025 @11:57PM (#45155264)
> Looking at the output and deciding "this is clearly wrong" does not count.

You need the ground truth to be able to make that determination, so using your knowledge does count. If you press the model to answer even when it does not know, you get confabulation. What today's models lack is the ability to measure their confidence, so they know when to abstain.

Re:Why Language Models Hallucinate by vrighter on Monday September 08, 2025 @05:11AM (#45166140)
so... vibes. got it. There is no ground truth to compare to in most cases. Because they are not in the training data where you can make objective quantifiable measurements on the statistics.
Re:Why Language Models Hallucinate by player1234 on Monday September 08, 2025 @05:46AM (#45166338)
There is no such thing as confidence regarding the actual facts, only confidence in probable output from the input. Factual confidence is impossible with current architecture.
Re:Why Language Models Hallucinate by 1718627440 on Monday September 08, 2025 @09:07AM (#45167785)
And having no ground truth is what defines a hallucination.