Re:OpenRouter raises $113M Series B
by lxgr on Saturday May 30, 2026 @06:36PM
(#48341274)
That said, the KV cache is very much not stateless, so internally inference APIs will be highly incentivized to route requests to instances with as much a shared prefix cached as possible.
[ Parent
| on HN ]
There are no comments on this comment yet.