News for hackers. Stuff that matters.
Re:Gemma 4 QAT models: Optimizing compression for mobile and... by int_19h on Friday June 05, 2026 @07:31PM (#48419731)
Re:Gemma 4 QAT models: Optimizing compression for mobile and... by dofm on Saturday June 06, 2026 @02:01AM (#48421856)
Yeah — that is the base QAT model, and there are safetensors weights for the QAT version of the MTP drafter, but there are no MLX/GGUF versions. I think the answer is a combination of:

1) Gemma 4 MTP is too fresh for off-the-shelf software to use anyway

2) "you can convert them yourself" which is fine, obvs