News for hackers. Stuff that matters.

A comment on The Era of 1-bit LLMs: ternary parameters for cost-effective computing. Parent comment

Re:The Era of 1-bit LLMs: ternary parameters for cost-effect... by imtringued on Wednesday February 28, 2024 @10:45AM (#39539442)
I'm not sure what use that is, other than to maintain the KV cache across requests.
[ Parent | on HN ]

There are no comments on this comment yet.