Re:Open models by OpenAI
by danieldk on Tuesday August 05, 2025 @03:20PM
(#44802933)
Also: attention sinks (although implemented as extra trained logits used in attention softmax rather than attending to e.g. a prepended special token).
[ Parent
| on HN ]
There are no comments on this comment yet.