Re:MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per s...
by HarHarVeryFunny on Tuesday June 09, 2026 @08:36AM
(#48460306)
> and doesn't require different hardware
But it may well do. They mention TileRT in the announcement, so this speed comes from low level optimization for some specific GPU target.
With availability of SOTA western GPUs being scarce in China, they may well have a mishmash of different GPUs.
I think the answer is that there's a tradeoff here where additional throughput for a single person can be achieved only by tying up more resources than a normal request would, even when you take into account the fact that the normal request takes longer to finish. I'm not an expert, but some of the optimizations they describe, particularly the parallel prediction stuff, sound like they could take up extra resources.