Re:Facebook LLAMA is being openly distributed via torrents
by MacsHeadroom on Saturday March 04, 2023 @09:23PM
(#35026415)
You can run 7B (equal to GPT-3 175B), 13B (better than GPT-3 175B), or 30B (better than anything else publicly available) but probably not 65B with that much RAM on an M1.
That would be using the CPU, as the M1 GPU is not yet supported.
That would be using the CPU, as the M1 GPU is not yet supported.