Re:Building a personal, private AI computer on a budget
by Eisenstein on Wednesday February 12, 2025 @09:05AM
(#43025521)
We are talking about dynamically quantizing KV cache, not the model weights.
[ Parent
| on HN ]