If you don't run your own LLM proxy, how do you even know whats going on?

Re:If you don't run your own LLM proxy, how do you even know... by jubilanti on Sunday October 18, 2026 @09:27PM (#50147291)

Yeah you should run an LLM proxy, but imagine a world where LiteLLM and all the other LLM shovels weren't buggy vibecoded messes. And with the velocity of updates I feel there has to be vulnerabilities there. Or am I just holding it wrong? Anyone got a good alternative?

[ Parent | on HN ]

Re:If you don't run your own LLM proxy, how do you even know... by hoss1474489 on Sunday October 18, 2026 @09:37PM (#50147373)

Bifrost has been decent, despite being partially shareware

[ Parent | on HN ]

Re:If you don't run your own LLM proxy, how do you even know... by what on Sunday October 18, 2026 @09:57PM (#50147470)

Imagine complaining about “buggy vibecoded messes” that you want to use to produce your own buggy vibe coded mess.

[ Parent | on HN ]

Re:If you don't run your own LLM proxy, how do you even know... by user37747273 on Monday October 19, 2026 @01:39AM (#50148768)

This general phenomenon is not new, but it has been so obvious during 2026. Everyone want to consume everyone else hard work, to create their own slop. Just pure egoism.

[ Parent | on HN ]

Re:If you don't run your own LLM proxy, how do you even know... by ij23 on Monday October 19, 2026 @01:24PM (#50155214)

Hi, I'm sorry you feel this way about LiteLLM. We're actively working on improving code quality / reducing bugs. Were there any specific pain points you faced with LiteLLM?

If you're open to a convo, I'd love to hear what specifically about the product was not great and improve it for you :)

My [LinkedIn](https://www.linkedin.com/in/reffajnaahsi/) if you're open to a convo.

[ Parent | on HN ]