News for hackers. Stuff that matters.
Re:A global workspace in language models by gwerbin on Monday July 06, 2026 @10:46PM (#48813111)
That's a cool result because that's also kind of what's happening inside the transformer unit: project -> QKV fuzzy lookup -> unproject. And in a different direction, it's analogous in some sense to what's happening in stacked convolutional layers, where the layers at different levels learn to recognize features of increasing detail.

There are no comments on this comment yet.