Re:LLaMA Now Goes Faster on CPUs
by fragmede on Monday April 01, 2024 @04:05AM
(#39891792)
It would also help if I had more VRAM and wasn't running a 7B parameter 4-bit quantized model.
[ Parent
| on HN ]
There are no comments on this comment yet.