News for hackers. Stuff that matters.
Re:Falcon 40B LLM (which beats Llama) now Apache 2.0 by GaggiX on Friday June 02, 2023 @02:00AM (#36161599)
From what I can find online LLAMA-65B 4-bit quantized can run 1 token/s on a Ryzen 7 3700X (using llama.cpp).

There are no comments on this comment yet.