Re:Hallucination is inevitable: An innate limitation of larg...
by bonzaidrinkingb on Sunday February 25, 2024 @02:35PM
(#39503998)
We use "confabulation".
It is a feature, not a bug.
"confabulation" could be "solved" when LLMs realize they are uncertain on a reply and making things up. But that requires the LLM saying "I don't know" and rewarding that more than a wrong guess. That requires a change in loss functions and not even sure if all users desire that.
It is a feature, not a bug.
"confabulation" could be "solved" when LLMs realize they are uncertain on a reply and making things up. But that requires the LLM saying "I don't know" and rewarding that more than a wrong guess. That requires a change in loss functions and not even sure if all users desire that.