News for hackers. Stuff that matters.
Re:LLMs use a surprisingly simple mechanism to retrieve some... by tel on Monday April 01, 2024 @09:28PM (#39901408)
I think part of what I suspect is going on here too is more computation and finiteness. It seems correct that LLM architectures cannot perform too much computation (unless you unroll it in the context).

On the other hand you can look at statistical model identification in, say, nonlinear control. This can absolutely lead to unboundedly long predictions.

There are no comments on this comment yet.