Re:Gemma 2: Improving Open Language Models at a Practical Si...
by luke-stanley on Thursday June 27, 2024 @11:49AM
(#40811787)
I know the safe tensors are there, but I said GGUF 4-bit quantised, which is kinda the standard for useful local applications, a typical balanced sweet spot of performance and quality. It's makes it much easier to use, works in more places, be it personal devices or a server etc.
[ Parent
| on HN ]
There are no comments on this comment yet.