News for hackers. Stuff that matters.
Re:Large language models are having their Stable Diffusion m... by JoeMattie on Saturday March 11, 2023 @09:39PM (#35115850)
I've got the (4-bit quantized) 65B param model running at somewhat acceptable speed on an i9-7900. It uses around 55GB of RAM.

There are no comments on this comment yet.