News for hackers. Stuff that matters.
Re:Anthropic IPO by mxschumacher on Thursday November 12, 2026 @07:35AM (#50466268)
the answer is to use a gateway that all the prompts go through. There are many proprietary and open source solutions for this. You get the benefit of making it trivial to switch between proprietary providers in case you are unhappy with the performance or squeezed on price. The AI Gateways put cap on LLM providers' margin upside.

Additionally, the gateway allows for caching, additional security checks, centralized monitoring. I think most corporations have a multi-provider setup anyway.

There are no comments on this comment yet.