News for hackers. Stuff that matters.
Re:Detecting when LLMs are uncertain by jawns on Friday October 25, 2024 @01:56PM (#41947753)
The way this is being described is almost like a maze-traversal algorithm, where compute time is "how far I'm willing to go down a path to test whether it's a possible solution." I wonder what other parallels we might find. For instance, are some of the maze-solving algorithms relevant to apply to LLMs?
Re:Detecting when LLMs are uncertain by radarsat1 on Friday October 25, 2024 @02:42PM (#41948300)
Sampling sequentially to find the highest joint probability over the sequence is definitely a search problem. that's why you see algorithms like beam search often used for sampling.
Re:Detecting when LLMs are uncertain by trq_ on Friday October 25, 2024 @01:58PM (#41947769)
Yes that's right, it seems like an area of more research.

Honestly it goes counter to the Bitter Lesson (http://www.incompleteideas.net/IncIdeas/BitterLesson.html, which stems from getting too fancy about maze traversal in Chess. But at the scale LLMs are at right now, the improvements might be worth it.

Re:Detecting when LLMs are uncertain by menhguin on Friday October 25, 2024 @04:01PM (#41949084)
Hi, contributor to Entropix here. This is just my opinion, but I don't think it goes counter to the Bitter Lesson at all, because it's meant to leverage model computation capabilities. Several papers have suggested that models internally compute certainty (https://arxiv.org/abs/2406.16254), and in my view our method simply leverages this computation and factors it explicitly into decoding.

This is as opposed to pure sampling + next token prediction which basically randomly chooses a token. So if a model does 1274 x 8275 and it's not very sure of the answer, it still confidently gives an answer even though it's uncertain and needs to do more working.

Re:Detecting when LLMs are uncertain by danielmarkbruce on Friday October 25, 2024 @05:05PM (#41949767)
100%. It's in line with bitter lesson learnings. Good going.
Re:Detecting when LLMs are uncertain by danielmarkbruce on Friday October 25, 2024 @05:04PM (#41949756)
Yeah i don't think it's counter at all. The bitter lesson calls out the fact that more computation/search wins.
Re:Detecting when LLMs are uncertain by jpfed on Tuesday October 29, 2024 @11:59AM (#41985535)
I also ask about approaching LLM decoding in terms of navigation, although from a different angle, in this reddit post: https://www.reddit.com/r/MachineLearning/comments/1dw2pqo/d_...