News for hackers. Stuff that matters.
Re:Let's Think Dot by Dot: Hidden Computation in Transformer... by diziet on Sunday April 28, 2024 @06:18AM (#40187453)
I believe the model is trained to always output the same number of dots. Additionally, the way LLMs generate output tokens are not really in in line with transferring state this way.

There are no comments on this comment yet.