News for hackers. Stuff that matters.
Re:Facebook LLAMA is being openly distributed via torrents by TaylorAlexander on Friday March 03, 2023 @01:59PM (#35013612)
The 13B parameter model is two 13.5GB chunks, but the 7B parameter model is one 13.5GB chunk so that one might be possible.

EDIT: There seems to be a lot of overhead. Here someone struggles to fit the 7B parameter model (13.5GB checkpoint) on a 24GB card: https://github.com/facebookresearch/llama/issues/55

There are no comments on this comment yet.