Re:Ollama has a native front end chatbot now
by jonahbenton on Wednesday July 30, 2025 @08:39PM
(#44741184)
OpenWebUI is what you are looking for from a usability perspective. Supports many models chat.
[ Parent
| on HN ]
Re:Ollama has a native front end chatbot now
by doctoboggan on Wednesday July 30, 2025 @09:56PM
(#44741600)
Last I tried OpenWebUI (A few months ago), it was pretty painful to connect non-OpenAI externally hosted models. There was a workaround that involved installing a 3rd party "function" (or was it a "pipeline"?), but it didn't feel smooth.
Is this easier now? Specifically, I would like to easily connect anthropic models just by plugging in my API key.
Re:Ollama has a native front end chatbot now
by jerieljan on Thursday July 31, 2025 @06:30AM
(#44744207)
The trick to this is to run a LiteLLM proxy that has all the connections to whatever you need to connect to and then point Open-WebUI to that.
I've been using this setup for several months now (over a year?) and it's very effective.
The proxy also benefits pretty much any other application you have that recognizes an OpenAI-compatible API. (Or even if it doesn't)
Re:Ollama has a native front end chatbot now
by gullevek on Friday August 01, 2025 @01:32AM
(#44753301)
No, still the same, otoh, it works perfectly fine for Claude, and that is the only one I use. I just wished they would finally add native support for this ...
Re:Ollama has a native front end chatbot now
by jwrallie on Wednesday July 30, 2025 @08:51PM
(#44741253)
I tried LibreChat and OpenWebUI, between the two I would recommend OpenWebUI.
It feels a bit less polished but has more functions that run locally and things work better out of the box.
My favorite thing is that I can just type my own questions / requests in markdown so I can get formatting and syntax highlighting.
Re:Ollama has a native front end chatbot now
by Eisenstein on Wednesday July 30, 2025 @10:05PM
(#44741653)
OpenWebUI refuses to support MCP and uses an MCP to OpenAPI proxy which often doesn't work. If you don't like or need MCP, then it is a good choice.
Re:Ollama has a native front end chatbot now
by pmarreck on Wednesday July 30, 2025 @10:41PM
(#44741844)
> refuses to support MCP
Why is that? Seems the way to go to add tooling to any LLM that is tool-capable
Re:Ollama has a native front end chatbot now
by halJordan on Wednesday July 30, 2025 @10:56PM
(#44741929)
The dev is very opinionated
Re:Ollama has a native front end chatbot now
by kid64 on Thursday July 31, 2025 @12:19AM
(#44742265)
Does https://github.com/open-webui/mcpo/ not fill this gap?
Re:Ollama has a native front end chatbot now
by Eisenstein on Thursday July 31, 2025 @02:11AM
(#44742812)
That is the initially mentioned MCP to OpenAPI proxy.
EDIT: To add a bit, MCP is more than just tools, which is the only use case MCPO supports.