News for hackers. Stuff that matters.
Re:Parameter-Free KV Cache Compression for Memory-Efficient ... by vlovich123 on Friday March 28, 2025 @11:42AM (#43506814)
Ah OK. So this is for resuming chat context cheaply. What I said is still correct - 3FS is not part of the inference flow & not relevant to the paper which is about optimizing the KV cache usage at runtime.

There are no comments on this comment yet.