Re:MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per s...
by SwellJoe on Tuesday June 09, 2026 @04:50AM
(#48458442)
8-bit on that one (unsloth 8_K_XL). But, the next post compares all common quantizations of Qwen 3.6.
I have another coming in a day or so for Gemma 4 with the 4-bit QAT version, which is very surprising (in a good way, Gemma 4 is impressive for this task).
I have another coming in a day or so for Gemma 4 with the 4-bit QAT version, which is very surprising (in a good way, Gemma 4 is impressive for this task).