News for hackers. Stuff that matters.

A comment on StreamingLLM: tiny tweak to KV LRU improves long conversations.

Re:StreamingLLM: tiny tweak to KV LRU improves long conversa... by popinman322 on Tuesday February 13, 2024 @04:36AM (#39356054)
Previous discussion, on a link to the implementation: https://news.ycombinator.com/item?id=37740932
[ Parent | on HN ]

There are no comments on this comment yet.