News for hackers. Stuff that matters.
Re:A comprehensive guide to running Llama 2 locally by flangola7 on Tuesday July 25, 2023 @07:55PM (#36871345)
What is necessary to run 70B on CPU without quantization?
Re:A comprehensive guide to running Llama 2 locally by ewokone on Wednesday July 26, 2023 @10:24AM (#36878253)
Bump. interested as well.