News for hackers. Stuff that matters.
Re:Real-Time Introspective Compression for Transformers by eigenvalue on Wednesday April 02, 2025 @03:43PM (#43560705)
Interesting, it certainly wouldn’t take up much additional space, but I wonder if it would have any real impact, since it seems somewhat orthogonal to finding a faithful low-dimensional encoding of the activations.

There are no comments on this comment yet.