News for hackers. Stuff that matters.

A comment on Some Thoughts on Autoregressive Models.

Re:Some Thoughts on Autoregressive Models by DeathArrow on Friday March 07, 2025 @12:52AM (#43287639)
>Most generative AI models nowadays are autoregressive.

There are also diffusion based models which don't rely on next token prediction.

[ Parent | on HN ]
Re:Some Thoughts on Autoregressive Models by Wonderfall on Friday March 07, 2025 @08:29AM (#43289984)
Yeah, this is mentioned in the article. (The LLaDa paper is even what triggered its writing!)
[ Parent | on HN ]