News for hackers. Stuff that matters.
Re:If you don't run your own LLM proxy, how do you even know... by pavelmelnichuk on Monday October 19, 2026 @07:26PM (#50159367)
not really, for example relay gives you model "groups" ie: fallbacks if one is down, or prefer to use a free-endpoint while you have daily capacity, etc.

Maybe you need a decision model to route, or maybe you want to have guardrail-type models pre or post response for an enterprise client.

Re:If you don't run your own LLM proxy, how do you even know... by CharlieDigital on Tuesday October 20, 2026 @05:40AM (#50163530)