News for hackers. Stuff that matters.

A comment on Run Llama 3 405B on home cluster (Distributed Llama).

Re:Run Llama 3 405B on home cluster (Distributed Llama) by b4rtazz on Tuesday July 23, 2024 @06:34AM (#41044566)
Technically, should be enought 2 machines with 128 GB RAM or 4 machines with 64 GB RAM (Q40 weights).
[ Parent | on HN ]

There are no comments on this comment yet.