Ask HN: Browser-UI with multi-LLM for the team?
I want to have browser-based UI (like ChatGPT) to upload files, get Markdown-reponses and have price control to avoid unexpected high costs at the end of the month. My current plan is to purchase API keys from different LLM providers and use LiteLLM as a proxy to setup cost limits OR to use OpenRouter.ai (potentially still using LiteLLM).
LibreChat currently doesn't support "passing through" uploads, but this feature is expected to be implemented this week: https://github.com/danny-avila/LibreChat/discussions/3760#discussioncomment-10445600
My Questions:
1. Is my approach using LiteLLM or OpenRouter with a UI a viable solution? I believe this could be more cost-effective than purchasing monthly chat accounts for each of the four users.
2. Are there other UIs similar to ChatGPT and Anthropic's interfaces, for the case that the new LibreChat attachment feature is too instable?
I don't use typingmind as a team, but they do have a team product and typingmind can be hooked into any LLM service.
https://www.typingmind.com/
Is a good tool.
Our team is very diverse and has no IT background. So we don't use collaborative tools (except MS Teams), but that doesn't stand in the way of productivity - it's powered by chaos.
Thanks, I'll have a look at TypeMind. It's disappointing that the tool is closed source and that no modifications are possible or permitted. I briefly add in my requirements that I would like to have a self-hosted open source tool.
Additionally, would love to chat about your use case. Seems really interesting. My co-founder and I are building out a solution to a similar problem.
Ping me, email is in the bio.
About the use case: Ultimately, I just want to enable my team to use different LLMs without having to create an account for each team member. However, it should be possible to upload attachments. RAG is not required at the moment.
Built around teams so you can build and share AI assistants based on your data.