Re:How Is LLaMa.cpp Possible?
by lhl on Wednesday August 16, 2023 @08:17AM
(#37145888)
Just the other day someone published ARC comparison results for different quants as well as the code for the harness that they used to easily run lm-eval against quants to your heart's content: https://www.reddit.com/r/LocalLLaMA/comments/15rh3op/effects...
[ Parent
| on HN ]
There are no comments on this comment yet.