News for hackers. Stuff that matters.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by LarsDu88 on Monday July 20, 2026 @02:14PM (#48982641)
At 9000 tokens/s you could interleave a lot of requests so long as pre-fill is also fast. It really depends on how much you need to keep sessions open to take advantage of KV caching

There are no comments on this comment yet.