News for hackers. Stuff that matters.
Re:Detecting when LLMs are uncertain by zby on Saturday October 26, 2024 @02:56AM (#41953060)
There are claims that it improves the LLMs on an array of benchmarks - if that is confirmed - wouldn't it be more important than the theory?
Re:Detecting when LLMs are uncertain by tbalsam on Saturday October 26, 2024 @08:46AM (#41954422)
People make claims all the time on Twitter that don't end up really panning out.

Above explains why it may work within the scope of theory despite being a poor method, but the success rate of methods like these is generally low enough to not be useful.

I'll give it more attention if they actually release conclusive benchmarks showing that it works instead of simply claiming it works, which is a big difference.