News for hackers. Stuff that matters.

A comment on Gemma 3 QAT Models: Bringing AI to Consumer GPUs. Parent comment

Re:Gemma 3 QAT Models: Bringing AI to Consumer GPUs by nolist_policy on Sunday April 20, 2025 @03:05PM (#43745787)
I suspect your "original gemma3:27b" was a quantized model since the non-quantized (16bit) version needs around 54gb.
[ Parent | on HN ]

There are no comments on this comment yet.