News for hackers. Stuff that matters.

A comment on Nexus: An Open-Source AI Router for Governance, Control and Observability. Parent comment

Re:Nexus: An Open-Source AI Router for Governance, Control a... by SparkyMcUnicorn on Tuesday August 12, 2025 @12:47PM (#44878823)
What's the difference between "MCP Server Aggregation" and the litellm_proxy endpoint described here?

https://docs.litellm.ai/docs/mcp

[ Parent | on HN ]
Re:Nexus: An Open-Source AI Router for Governance, Control a... by tomhoule on Tuesday August 12, 2025 @01:39PM (#44879513)
The main difference is that while you can get Nexus to list all tools, by default the LLM accesses tools by semantic search — Nexus returns only the relevant tools for the what the LLM is trying to accomplish. Also, Nexus speaks MCP to the LLM, it doesn't translate like litellm_proxy seems to do (I wasn't familiar with it previously).
[ Parent | on HN ]