Re:Hetzner is working on LLM Inference
by jonas_scholz on Friday July 24, 2026 @07:45AM
(#49034210)
yea, but no prompt caching right? This makes it unusable for my usecase at least, the cost would be insane
Re:Hetzner is working on LLM Inference
by PaoloBarbolini on Friday July 24, 2026 @11:28AM
(#49037103)
They confirmed on LinkedIn that they are working on it.
Also, they have a feature request that has been getting many votes recently: https://feature-request.scaleway.com/posts/1251/prompt-cachi...
https://www.scaleway.com/en/generative-apis/
https://www.scaleway.com/en/inference/