News for hackers. Stuff that matters.
Re:The "Chain of Thought" Delusions by sega_sai on Sunday May 12, 2024 @07:11AM (#40333482)
My understanding is that the main limitation of LLM is that their are single pass. I.e. they process once and return they answer. If that answer is correct that's great but if they answer doesn't make sense LLM has no ability to retrace steps. That is exactly why breaking into steps is useful, because each step is easier to quickly answer. I think at some point people will combine the LLM with some kind of LLM-critic that will enable automatic splitting into steps or reruns of the LLM.
Re:The "Chain of Thought" Delusions by pona-a on Sunday May 12, 2024 @09:44AM (#40334404)
> ...If they answer doesn't make sense LLM has no ability to retrace the steps.

Beam search already exists, it precisely allows the model to backtrack on its past tokens and find the global maxima of probability, at least within set depth/breadth. I think this is just a larger limitation of their shallow world model. Perhaps giving transformers registers will remedy this.