Re:Gemma 4 QAT models: Optimizing compression for mobile and...
by int_19h on Friday June 05, 2026 @07:31PM
(#48419731)
https://huggingface.co/lmstudio-community/gemma-4-26B-A4B-it...
[ Parent
| on HN ]
Re:Gemma 4 QAT models: Optimizing compression for mobile and...
by dofm on Saturday June 06, 2026 @02:01AM
(#48421856)
Yeah — that is the base QAT model, and there are safetensors weights for the QAT version of the MTP drafter, but there are no MLX/GGUF versions. I think the answer is a combination of:
1) Gemma 4 MTP is too fresh for off-the-shelf software to use anyway
2) "you can convert them yourself" which is fine, obvs