News for hackers. Stuff that matters.
Re:MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per s... by boutell on Monday June 08, 2026 @12:46PM (#48447728)
I wonder about this too. The other objections miss the point: if it's faster, and otherwise the same, and doesn't require different hardware, then why not just announce that the standard tier of MiMo-v.25-Pro is now ridiculously fast and raise the price? What does "limited high speed resources" mean if it runs on the same hardware as the rest of their pool?

I think the answer is that there's a tradeoff here where additional throughput for a single person can be achieved only by tying up more resources than a normal request would, even when you take into account the fact that the normal request takes longer to finish. I'm not an expert, but some of the optimizations they describe, particularly the parallel prediction stuff, sound like they could take up extra resources.

Re:MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per s... by HarHarVeryFunny on Tuesday June 09, 2026 @08:36AM (#48460306)
> and doesn't require different hardware

But it may well do. They mention TileRT in the announcement, so this speed comes from low level optimization for some specific GPU target.

With availability of SOTA western GPUs being scarce in China, they may well have a mishmash of different GPUs.

Re:MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per s... by boutell on Tuesday June 09, 2026 @09:19AM (#48460775)
They specifically said it's stock hardware, but... yeah, maybe highly specific stock hardware.