Re:A global workspace in language models
by gwerbin on Monday July 06, 2026 @10:46PM
(#48813111)
That's a cool result because that's also kind of what's happening inside the transformer unit: project -> QKV fuzzy lookup -> unproject. And in a different direction, it's analogous in some sense to what's happening in stacked convolutional layers, where the layers at different levels learn to recognize features of increasing detail.
[ Parent
| on HN ]
There are no comments on this comment yet.