News for hackers. Stuff that matters.

A comment on Detecting when LLMs are uncertain. Parent comment

Re:Detecting when LLMs are uncertain by TZubiri on Friday October 25, 2024 @03:48PM (#41948949)
Right. The uncertainty will be high when responding to garbage inputs and it will be distributed along many tokens.

If probability(sum(tokens[:5])) < 0.5: Respond("I'm sorry I don't quite understand what you mean.")

[ Parent | on HN ]

There are no comments on this comment yet.