Re:Mistral 7B, the most powerful language model for its size...
by polygamous_bat on Wednesday September 27, 2023 @11:27AM
(#37676071)
"Unquantized" is the key word here: with quantization you can get a 4-8x improvement without much performance degradation.
[ Parent
| on HN ]
There are no comments on this comment yet.