so... vibes. got it. There is no ground truth to compare to in most cases. Because they are not in the training data where you can make objective quantifiable measurements on the statistics.
Re:Why Language Models Hallucinate
by player1234 on Monday September 08, 2025 @05:46AM
(#45166338)
There is no such thing as confidence regarding the actual facts, only confidence in probable output from the input. Factual confidence is impossible with current architecture.
Re:Why Language Models Hallucinate
by 1718627440 on Monday September 08, 2025 @09:07AM
(#45167785)
And having no ground truth is what defines a hallucination.
You need the ground truth to be able to make that determination, so using your knowledge does count. If you press the model to answer even when it does not know, you get confabulation. What today's models lack is the ability to measure their confidence, so they know when to abstain.