Re:Gemma 3 QAT Models: Bringing AI to Consumer GPUs
by superkuh on Sunday April 20, 2025 @04:50PM
(#43746439)
Quantization aware training just means having the model deal with quantized values a bit during training so it handles the quantization better when it is quantized after training/etc. It doesn't change the model size itself.
[ Parent
| on HN ]
There are no comments on this comment yet.