Re:Gemma 3 QAT Models: Bringing AI to Consumer GPUs
by parched99 on Sunday April 20, 2025 @09:50PM
(#43747892)
I answered the question directly. IQ4_X_S is smaller, but slower and less accurate than Q4_0. The parent comment specifically asked about the QAT version. That's literally what this thread is about. The context-length mention was relevant to show how it's only barely usable.
[ Parent
| on HN ]
There are no comments on this comment yet.