Re:Anthropic silently downgraded cache TTL from 1h → 5M on M...
by paganel on Sunday April 12, 2026 @07:32PM
(#47745606)
> When anyone can host open models
They'd still need to pay the actual power costs.
Re:Anthropic silently downgraded cache TTL from 1h → 5M on M...
by charcircuit on Sunday April 12, 2026 @07:45PM
(#47745748)
I didn't say that inference would be free, but that everything to do inference is a commodity which means that competition is easy to do.
Competition will prevent that from happening. When anyone can host open models and there is giant demand for LLMs companies can not easily raise token prices without sending a lot of traffic to their competitors.