Re:Parameter-Free KV Cache Compression for Memory-Efficient ...
by vlovich123 on Friday March 28, 2025 @11:42AM
(#43506814)
Ah OK. So this is for resuming chat context cheaply. What I said is still correct - 3FS is not part of the inference flow & not relevant to the paper which is about optimizing the KV cache usage at runtime.
[ Parent
| on HN ]
There are no comments on this comment yet.