News for hackers. Stuff that matters.
Re:LLaMA Now Goes Faster on CPUs by fragmede on Monday April 01, 2024 @04:05AM (#39891792)
It would also help if I had more VRAM and wasn't running a 7B parameter 4-bit quantized model.

There are no comments on this comment yet.