Re:If you don't run your own LLM proxy, how do you even know...
by pavelmelnichuk on Monday October 19, 2026 @07:26PM
(#50159367)
not really, for example relay gives you model "groups" ie: fallbacks if one is down, or prefer to use a free-endpoint while you have daily capacity, etc.
Maybe you need a decision model to route, or maybe you want to have guardrail-type models pre or post response for an enterprise client.
Maybe you need a decision model to route, or maybe you want to have guardrail-type models pre or post response for an enterprise client.