Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second. Parent comment
But it may well do. They mention TileRT in the announcement, so this speed comes from low level optimization for some specific GPU target.
With availability of SOTA western GPUs being scarce in China, they may well have a mishmash of different GPUs.
But it may well do. They mention TileRT in the announcement, so this speed comes from low level optimization for some specific GPU target.
With availability of SOTA western GPUs being scarce in China, they may well have a mishmash of different GPUs.