News for hackers. Stuff that matters.
Re:Started Llama 3.1 8B Locally by ingonealan3 on Wednesday August 21, 2024 @01:27AM (#41307041)
Weird post, could be misleading to others. You really don't need "multiple terabytes of SSD storage" to run Llama 3.1 70B. All you need is about 40GB for the model weights. Plus the tooling around it, which is assumed you've already installed.