News for hackers. Stuff that matters.
Re:Alice in Wonderland: Simple Tasks Showing Complete Reason... by logicchains on Wednesday June 05, 2024 @01:16PM (#40587638)
>For reasoning of any complexity, some sort of internal monologue and iteration is needed.

From a formal perspective you're entirely correct. Transformers with chain-of-thought are strictly more powerful than transformers without it, and can efficiently solve classes of problems that would otherwise require exponentially increasing model depth: https://arxiv.org/abs/2310.07923

There are no comments on this comment yet.