News for hackers. Stuff that matters.
Re:Open models by OpenAI by danieldk on Tuesday August 05, 2025 @03:20PM (#44802933)
Also: attention sinks (although implemented as extra trained logits used in attention softmax rather than attending to e.g. a prepended special token).

There are no comments on this comment yet.