Re:Hermes 3: The First Fine-Tuned Llama 3.1 405B Model
by Lerc on Thursday August 15, 2024 @08:09PM
(#41261841)
64GB of ram is 550b bits of ram. That doesn't give you a lot of options on how many bits you want to keep per model parameter.
[ Parent
| on HN ]
There are no comments on this comment yet.