News for hackers. Stuff that matters.
Re:Hetzner is working on LLM Inference by jonas_scholz on Friday July 24, 2026 @07:45AM (#49034210)
yea, but no prompt caching right? This makes it unusable for my usecase at least, the cost would be insane
Re:Hetzner is working on LLM Inference by PaoloBarbolini on Friday July 24, 2026 @11:28AM (#49037103)
They confirmed on LinkedIn that they are working on it.

Also, they have a feature request that has been getting many votes recently: https://feature-request.scaleway.com/posts/1251/prompt-cachi...