News for hackers. Stuff that matters.
Re:Ollama has a native front end chatbot now by jonahbenton on Wednesday July 30, 2025 @08:39PM (#44741184)
OpenWebUI is what you are looking for from a usability perspective. Supports many models chat.
Re:Ollama has a native front end chatbot now by doctoboggan on Wednesday July 30, 2025 @09:56PM (#44741600)
Last I tried OpenWebUI (A few months ago), it was pretty painful to connect non-OpenAI externally hosted models. There was a workaround that involved installing a 3rd party "function" (or was it a "pipeline"?), but it didn't feel smooth.

Is this easier now? Specifically, I would like to easily connect anthropic models just by plugging in my API key.

Re:Ollama has a native front end chatbot now by jerieljan on Thursday July 31, 2025 @06:30AM (#44744207)
The trick to this is to run a LiteLLM proxy that has all the connections to whatever you need to connect to and then point Open-WebUI to that.

I've been using this setup for several months now (over a year?) and it's very effective.

The proxy also benefits pretty much any other application you have that recognizes an OpenAI-compatible API. (Or even if it doesn't)

Re:Ollama has a native front end chatbot now by gullevek on Friday August 01, 2025 @01:32AM (#44753301)
No, still the same, otoh, it works perfectly fine for Claude, and that is the only one I use. I just wished they would finally add native support for this ...
Re:Ollama has a native front end chatbot now by jwrallie on Wednesday July 30, 2025 @08:51PM (#44741253)
I tried LibreChat and OpenWebUI, between the two I would recommend OpenWebUI.

It feels a bit less polished but has more functions that run locally and things work better out of the box.

My favorite thing is that I can just type my own questions / requests in markdown so I can get formatting and syntax highlighting.

Re:Ollama has a native front end chatbot now by Eisenstein on Wednesday July 30, 2025 @10:05PM (#44741653)
OpenWebUI refuses to support MCP and uses an MCP to OpenAPI proxy which often doesn't work. If you don't like or need MCP, then it is a good choice.
Re:Ollama has a native front end chatbot now by pmarreck on Wednesday July 30, 2025 @10:41PM (#44741844)
> refuses to support MCP

Why is that? Seems the way to go to add tooling to any LLM that is tool-capable

Re:Ollama has a native front end chatbot now by halJordan on Wednesday July 30, 2025 @10:56PM (#44741929)
The dev is very opinionated
Re:Ollama has a native front end chatbot now by kid64 on Thursday July 31, 2025 @12:19AM (#44742265)
Does https://github.com/open-webui/mcpo/ not fill this gap?
Re:Ollama has a native front end chatbot now by Eisenstein on Thursday July 31, 2025 @02:11AM (#44742812)
That is the initially mentioned MCP to OpenAPI proxy.

EDIT: To add a bit, MCP is more than just tools, which is the only use case MCPO supports.

Re:Ollama has a native front end chatbot now by wkat4242 on Wednesday July 30, 2025 @08:45PM (#44741219)
Another +1 for OpenWebUI. Development is also going really fast <3