Re:Falcon 40B LLM (which beats Llama) now Apache 2.0
by GaggiX on Friday June 02, 2023 @02:00AM
(#36161599)
From what I can find online LLAMA-65B 4-bit quantized can run 1 token/s on a Ryzen 7 3700X (using llama.cpp).
[ Parent
| on HN ]
There are no comments on this comment yet.