News for hackers. Stuff that matters.
Re:Chain-of-Thought Can Hurt Performance on Tasks Where Thin... by jltsiren on Wednesday October 30, 2024 @09:59PM (#42002687)
Finite-state machines are a limited model. In principle, you can use them to model everything that can fit in the observable universe. But that doesn't mean they are a good model for most purposes.

The biggest limitation with the current LLMs is the artificial separation between training and inference. Once deployed, they are eternally stuck in the same moment, always reacting but incapable of learning. At best, they are snapshots of a general intelligence.

I also have a vague feeling that a fixed set of tokens is a performance hack that ultimately limits the generality of LLMs. That hardcoded assumptions make tasks that build on those assumptions easier and seeing past the assumptions harder.

Re:Chain-of-Thought Can Hurt Performance on Tasks Where Thin... by alexwebb2 on Wednesday October 30, 2024 @10:37PM (#42002905)
> At best, they are snapshots of a general intelligence.

So are we, at any given moment.