Re:Show HN: Any-LLM – Lightweight router to access any LLM P...
by retrovrv on Tuesday July 22, 2025 @04:00PM
(#44652309)
we essentially built the gateway as a service rather than an SDK: https://github.com/portkey-AI/gateway
Re:Show HN: Any-LLM – Lightweight router to access any LLM P...
by pzo on Tuesday July 22, 2025 @03:34PM
(#44651997)
for js/ts you have vercel aisdk [0], for c++ you have [1], for flutter/reactnative/kotlin there is [2]
[0] https://github.com/vercel/ai
Re:Show HN: Any-LLM – Lightweight router to access any LLM P...
by Shark1n4Suit on Tuesday July 22, 2025 @06:31PM
(#44653756)
That's the key question. It feels like many of these tools are trying to solve a systems-level problem (cross-language model execution) at the application layer (with a Python library).
A truly universal solution would likely need to exist at a lower level of abstraction, completely decoupling the application's language from the model's runtime. It's a much harder problem to solve there, but it would be a huge step forward.
Why Python? Probably because most of the SDKs are python, but something that could be ported across languages without requiring an interpreter would have been really amazing.