News for hackers. Stuff that matters.
Re:26× Faster Inference with Layer-Condensed KV Cache for La... by VeejayRampay on Monday May 20, 2024 @04:21PM (#40419843)
it sure is huge, but it's still far from 26x

There are no comments on this comment yet.