News for hackers. Stuff that matters.
Re:Hermes 3: The First Fine-Tuned Llama 3.1 405B Model by Lerc on Thursday August 15, 2024 @08:09PM (#41261841)
64GB of ram is 550b bits of ram. That doesn't give you a lot of options on how many bits you want to keep per model parameter.

There are no comments on this comment yet.