News for hackers. Stuff that matters.
Re:Mistral 7B, the most powerful language model for its size... by polygamous_bat on Wednesday September 27, 2023 @11:27AM (#37676071)
"Unquantized" is the key word here: with quantization you can get a 4-8x improvement without much performance degradation.

There are no comments on this comment yet.