News for hackers. Stuff that matters.
Re:Self-hosted inference orchestrators compared: LocalAI, ex... by polotics on Sunday September 20, 2026 @04:08PM (#49779555)
what exactly did you mean when xou wrote this paragraph title: "LiteLLM — a router, not a runtime' ?
Re:Self-hosted inference orchestrators compared: LocalAI, ex... by nextime on Monday September 21, 2026 @03:24AM (#49784089)
I wouldn't wrote as it, sorry, the post was an unintended generated post, wasn't supposed to post for real, until i was going to rewrite it by hand at least.

The meaning for that sentence is that litellm just route requests, it doesn't execute a model.