News for hackers. Stuff that matters.

A comment on Nvidia releases 8B model with learned 8x KV cache compression.

Re:Nvidia releases 8B model with learned 8x KV cache compres... by alecco on Saturday January 24, 2026 @02:38PM (#46746870)
The paper behind it was presented in December 2025 Neurips

Release thread: https://xcancel.com/p_nawrot/status/2014770473289019709

Slides and audio presentation: https://neurips.cc/virtual/2025/loc/san-diego/poster/119605

[ Parent | on HN ]

There are no comments on this comment yet.