News for hackers. Stuff that matters.

A comment on Dalai: Automatically install, run, and play with LLaMA on your computer. Parent comment

Re:Dalai: Automatically install, run, and play with LLaMA on... by spion on Monday March 13, 2023 @06:02AM (#35133497)
llama.cpp needs 40GB for the 65B model (due to int4 quantization)

RamNeeded(other_weight) = 40GB * other_weight/65B

[ Parent | on HN ]

There are no comments on this comment yet.