News for hackers. Stuff that matters.

A comment on How Is LLaMa.cpp Possible?. Parent comment

Re:How Is LLaMa.cpp Possible? by astrange on Wednesday August 16, 2023 @03:17AM (#37143764)
This paper from last month has a method for acceptable 3-bit quantization and a start at 2-bit.

https://arxiv.org/abs/2307.13304

[ Parent | on HN ]

There are no comments on this comment yet.