News for hackers. Stuff that matters.
Re:Language Models Pack Billions of Concepts into 12,000 Dim... by mutkach on Monday September 15, 2025 @04:07AM (#45247275)
How would you peer-review something like that? Or rather, how would you even _reproduce_ any of that? Some inception-based model with some synthetic data? Where is the data? I'm sure the paper was written in good faith, but all it leads to is just more crackpottery. If I had a penny for each time I've heard that LLMs are quantum in nature "because softmax is essentially a wave function collapse" and "because superposition," then I would have more than one penny!

There are no comments on this comment yet.