News for hackers. Stuff that matters.
Re:Detecting when LLMs are uncertain by nopinsight on Friday October 25, 2024 @02:37PM (#41948238)
The new Claude Sonnet 3.5 does something like that in my experience.
Re:Detecting when LLMs are uncertain by trq_ on Friday October 25, 2024 @02:39PM (#41948259)
Yeah wouldn't be surprised if the big labs are doing more than just arg max in the sampling.