Re:Real-Time Introspective Compression for Transformers
by eigenvalue on Wednesday April 02, 2025 @03:43PM
(#43560705)
Interesting, it certainly wouldn’t take up much additional space, but I wonder if it would have any real impact, since it seems somewhat orthogonal to finding a faithful low-dimensional encoding of the activations.
[ Parent
| on HN ]
There are no comments on this comment yet.