News for hackers. Stuff that matters.
Re:Show HN: Any-LLM – Lightweight router to access any LLM P... by piker on Tuesday July 22, 2025 @03:16PM (#44651748)
This looks awesome.

Why Python? Probably because most of the SDKs are python, but something that could be ported across languages without requiring an interpreter would have been really amazing.

Re:Show HN: Any-LLM – Lightweight router to access any LLM P... by retrovrv on Tuesday July 22, 2025 @04:00PM (#44652309)
we essentially built the gateway as a service rather than an SDK: https://github.com/portkey-AI/gateway
Re:Show HN: Any-LLM – Lightweight router to access any LLM P... by pzo on Tuesday July 22, 2025 @03:34PM (#44651997)
for js/ts you have vercel aisdk [0], for c++ you have [1], for flutter/reactnative/kotlin there is [2]

[0] https://github.com/vercel/ai

[1] https://github.com/ClickHouse/ai-sdk-cpp

[2] https://github.com/cactus-compute/cactus

Re:Show HN: Any-LLM – Lightweight router to access any LLM P... by Shark1n4Suit on Tuesday July 22, 2025 @06:31PM (#44653756)
That's the key question. It feels like many of these tools are trying to solve a systems-level problem (cross-language model execution) at the application layer (with a Python library).

A truly universal solution would likely need to exist at a lower level of abstraction, completely decoupling the application's language from the model's runtime. It's a much harder problem to solve there, but it would be a huge step forward.