News for hackers. Stuff that matters.
Re:OpenRouter raises $113M Series B by lxgr on Saturday May 30, 2026 @06:36PM (#48341274)
That said, the KV cache is very much not stateless, so internally inference APIs will be highly incentivized to route requests to instances with as much a shared prefix cached as possible.

There are no comments on this comment yet.