News for hackers. Stuff that matters.
Re:Tracing the thoughts of a large language model by kazinator on Thursday March 27, 2025 @03:00PM (#43496874)
By the way, there was recently a HN submission about a project studying using diffusion models rather than LLM for token prediction. With diffusion, tokens aren't predicted strictly left to right any more; there can be gaps that are backfilled. But: it's still essentially the same, I think. Once that type of model settles on a given token at a given position, it commits to that. Just more possible permutations of the token filling sequence have ben permitted.

There are no comments on this comment yet.