News for hackers. Stuff that matters.

A comment on Running LLaMA 7B on a 64GB M2 MacBook Pro with Llama.cpp. Parent comment

Re:Running LLaMA 7B on a 64GB M2 MacBook Pro with Llama.cpp by MacsHeadroom on Saturday March 11, 2023 @10:07PM (#35116050)
They can and they have been look on HuggingFace or search torrent sites.

You only actually need about 30GB of VRAM (or unified memory) and no ram to run the largest 65B model.

[ Parent | on HN ]

There are no comments on this comment yet.