News for hackers. Stuff that matters.
Re:MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per s... by RussianCow on Monday June 08, 2026 @12:58PM (#48447889)
But those things won't be sped up by a faster LLM, so I feel like that's not what the OP is talking about.
Re:MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per s... by goyozi on Monday June 08, 2026 @01:12PM (#48448078)
Well, I used an extreme example. OTOH, I’ve done quite a few of those „fix CI” or „migrate X” prompts recently and while there is a fixed component like running CI / builds, I’d say the LLM time is still around or above 50%, especially at the beginning of the project. Then there’s also regular tasks that now take minutes per message which completely get me out of the zone. I imagine iterating on those in near real time would be a big change.