News for hackers. Stuff that matters.
Re:Ollama has a native front end chatbot now by apitman on Wednesday July 30, 2025 @07:59PM (#44740957)
I've been on something of a quest to find a really good chat interface for LLMs.

Most import feature for me is that I want to be able to chat with local models, remote models on my other machines, and cloud models (OpenAI API compatible). Anything that makes it easier to switch between models or query them simultaneously is important.

Here's what I've learned so far:

* Msty - my current favorite. Can do true simultaneous requests to multiple models. Nice aesthetic. Sadly not open source.

* Jan.ai - Can't make requests to multiple models simultaneously

* LM Studio - Not open source. Doesn't support remote/cloud models (maybe there's a plugin?)

* GPT4All - Was getting weird JSON errors with openrouter models. Have to explicitly switch between models, even if you're trying to use them from different chats.

Still to try: Librechat, Open WebUI, AnythingLLM, koboldcpp.

Would love to hear any other suggestions.

Re:Ollama has a native front end chatbot now by khimaros on Wednesday July 30, 2025 @08:04PM (#44740980)
CherryStudio is a power tool for this case https://github.com/CherryHQ/cherry-studio -- has MCP, search, personas, and reasoning support too. i use it heavily with llama.cpp + llama-swap
Re:Ollama has a native front end chatbot now by Eisenstein on Thursday July 31, 2025 @05:12AM (#44743808)
Have fun on their Issues page if you don't read and write Chinese. Documentation pages are written in Chinese as well.
Re:Ollama has a native front end chatbot now by tpae on Wednesday July 30, 2025 @08:22PM (#44741067)
I've been building this: https://dinoki.ai/

Works fully local, privacy first, and it's a native app (Swift for macOS, WPF for Windows)

Re:Ollama has a native front end chatbot now by onprema on Wednesday July 30, 2025 @08:38PM (#44741179)
this looks so cool! :)
Re:Ollama has a native front end chatbot now by tpae on Wednesday July 30, 2025 @08:43PM (#44741208)
Thank you! Try it out and give us feedback
Re:Ollama has a native front end chatbot now by gcr on Thursday July 31, 2025 @12:18AM (#44742257)
do you have any screenshots? the home page shows a picture of a tamagotchi but none of the actual chat interface, which makes me wonder if I’m outside of the target audience
Re:Ollama has a native front end chatbot now by Nekorosu on Thursday July 31, 2025 @02:40PM (#44748724)
That's an interesting take on the topic! Bought it to support the development.
Re:Ollama has a native front end chatbot now by navbaker on Wednesday July 30, 2025 @08:26PM (#44741098)
Our team has been using openwebui as the interface for our stack of open source models we run internally at work and it’s been fantastic! It has a great feature set, good support for MCPs, and is easy to stand up and maintain.
Re:Ollama has a native front end chatbot now by jonahbenton on Wednesday July 30, 2025 @08:39PM (#44741184)
OpenWebUI is what you are looking for from a usability perspective. Supports many models chat.
Re:Ollama has a native front end chatbot now by doctoboggan on Wednesday July 30, 2025 @09:56PM (#44741600)
Last I tried OpenWebUI (A few months ago), it was pretty painful to connect non-OpenAI externally hosted models. There was a workaround that involved installing a 3rd party "function" (or was it a "pipeline"?), but it didn't feel smooth.

Is this easier now? Specifically, I would like to easily connect anthropic models just by plugging in my API key.

Re:Ollama has a native front end chatbot now by jerieljan on Thursday July 31, 2025 @06:30AM (#44744207)
The trick to this is to run a LiteLLM proxy that has all the connections to whatever you need to connect to and then point Open-WebUI to that.

I've been using this setup for several months now (over a year?) and it's very effective.

The proxy also benefits pretty much any other application you have that recognizes an OpenAI-compatible API. (Or even if it doesn't)

Re:Ollama has a native front end chatbot now by gullevek on Friday August 01, 2025 @01:32AM (#44753301)
No, still the same, otoh, it works perfectly fine for Claude, and that is the only one I use. I just wished they would finally add native support for this ...
Re:Ollama has a native front end chatbot now by jwrallie on Wednesday July 30, 2025 @08:51PM (#44741253)
I tried LibreChat and OpenWebUI, between the two I would recommend OpenWebUI.

It feels a bit less polished but has more functions that run locally and things work better out of the box.

My favorite thing is that I can just type my own questions / requests in markdown so I can get formatting and syntax highlighting.

Re:Ollama has a native front end chatbot now by Eisenstein on Wednesday July 30, 2025 @10:05PM (#44741653)
OpenWebUI refuses to support MCP and uses an MCP to OpenAPI proxy which often doesn't work. If you don't like or need MCP, then it is a good choice.
Re:Ollama has a native front end chatbot now by pmarreck on Wednesday July 30, 2025 @10:41PM (#44741844)
> refuses to support MCP

Why is that? Seems the way to go to add tooling to any LLM that is tool-capable

Re:Ollama has a native front end chatbot now by halJordan on Wednesday July 30, 2025 @10:56PM (#44741929)
The dev is very opinionated
Re:Ollama has a native front end chatbot now by kid64 on Thursday July 31, 2025 @12:19AM (#44742265)
Does https://github.com/open-webui/mcpo/ not fill this gap?
Re:Ollama has a native front end chatbot now by Eisenstein on Thursday July 31, 2025 @02:11AM (#44742812)
That is the initially mentioned MCP to OpenAPI proxy.

EDIT: To add a bit, MCP is more than just tools, which is the only use case MCPO supports.

Re:Ollama has a native front end chatbot now by wkat4242 on Wednesday July 30, 2025 @08:45PM (#44741219)
Another +1 for OpenWebUI. Development is also going really fast <3
Re:Ollama has a native front end chatbot now by vFunct on Wednesday July 30, 2025 @09:06PM (#44741341)
This is something you can vibe code in a day. I vibe codes something similar as a component for my larger project.
Re:Ollama has a native front end chatbot now by gleenn on Wednesday July 30, 2025 @09:09PM (#44741353)
This is a snappy (perhaps too snappy at the expense of quality) open source mobile app for iPhones called Cactus Chat: https://apps.apple.com/us/app/cactus-chat/id6744444212
Re:Ollama has a native front end chatbot now by flashblaze on Wednesday July 30, 2025 @09:13PM (#44741389)
Thoughts about https://chorus.sh/
Re:Ollama has a native front end chatbot now by deadbabe on Wednesday July 30, 2025 @09:16PM (#44741405)
Once you use Open WebUI, your search will come to an end. Tread carefully.
Re:Ollama has a native front end chatbot now by egonschiele on Wednesday July 30, 2025 @09:35PM (#44741505)
Build your own! It's a great way to learn, keeps you interested in the latest developments. Plus you get to try out cool UX experiments and see what works. I built my own interface back in 2023 and have been slowly adding to it since. I added local models via MLX last month. I'm surprised more devs aren't rolling their own interface, they are easy to make and you learn a lot.
Re:Ollama has a native front end chatbot now by peterb on Wednesday July 30, 2025 @09:48PM (#44741557)
gptel in emacs does this. You can run the same prompt against different models in separate emacs windows (local or via api w/ keys) at the same time to compare outputs. I highly recommended it. https://github.com/karthink/gptel
Re:Ollama has a native front end chatbot now by bakugo on Wednesday July 30, 2025 @09:48PM (#44741560)
Open WebUI is definitely what you want. Supports any OpenAI-compatible provider, lets you manually configure your model list and settings for each model in a very user-friendly way, switching between models is instant, and it lets you send the same prompt to multiple models simultaneously in the same chat and displays them side by side.
Re:Ollama has a native front end chatbot now by fnordlord on Wednesday July 30, 2025 @10:38PM (#44741833)
I've been using AnythingLLM for a couple months now and really like it. You can organize different "Workspaces" which are models + specific prompts and it supports Ollama along with the major LLM providers. I have it running in a docker container on a raspberry pi and then I use Tailscale to make it accessible anywhere. It looks good on mobile too so it's pretty seamless. I use that and Raycast's Claude extension for random questions and that's pretty much does everything I want.
Re:Ollama has a native front end chatbot now by pmarreck on Wednesday July 30, 2025 @10:39PM (#44741838)
Re:Ollama has a native front end chatbot now by codpiece on Wednesday July 30, 2025 @10:40PM (#44741840)
I have tried most of those and tend to go back to dify.ai. Open source, connects to remote endpoints, test up to 4 models at a time.

I can create workflows that use multiple models to achieve different goals.

Re:Ollama has a native front end chatbot now by adsharma on Wednesday July 30, 2025 @11:57PM (#44742192)
Ask me anything.

Electron. Python backend. Can talk to Ollama and other backends.

Need help with design and packaging.

https://github.com/adsharma/ask-me-anything

Re:Ollama has a native front end chatbot now by teekert on Thursday July 31, 2025 @04:28AM (#44743591)
I like webUI but it’s weird and conplicated how you have to set up the different models (via text files in the browser, the instructions contains a lot of confusing terms). Librechat is nice but I can’t get it to not log me out every 5 min which makes it unusable. I’ve been told it keeps you logged in when using https but I use tailscale so that is difficult (when doing multiple services on a single host).
Re:Ollama has a native front end chatbot now by ojosilva on Thursday July 31, 2025 @07:17AM (#44744442)
I've been in the same quest for a while. Here's my list, not a recommendation or endorsement list, just a list of alternative clients I've considered, tried or am still evaluating:

- chatbox - https://github.com/chatboxai/chatbox - free and OSS, with a paid tier, supports MCP and local/remote, has a local KB, works well so far and looks promising.

- macai - https://github.com/Renset/macai simple client for remote APIs, does not support image pasting or MCP or anything really, very limited, crashes.

- typingmind.com - web, with a downloadable (if paid) version. Not OSS, but one-time payment, indie dev. One of the first alt chat clients I've ever tried, not using it anymore. Somewhat clunky gui, but ok. Supports MCP, haven't tried it it.

- Open WebUI - deployed for our team so that we could chat through many APIs. Works well for a multi-user web-deployment, but image generation hasn't been working. I don't like it as a personal client though, buggy sometimes but gets frequent fixes fortunately.

- jan.ai - it comes with popular models pre-populated listed, which makes it harder to plug into custom or local model servers. But it supports local model deployment within the app (like what ollama is announcing) which is good for people who don't want to deal with starting a server. I haven't played with it enough, but I personally prefer to deploy a local server (ie ollama, litellm...) and then just have the chat gui app give me a flexible endpoint configuration for adding custom models to it.

I'm also wary of evil actors deploying chat GUIs just to farm your API keys. You should be too. Use disposable api keys, watch usage, refresh with new keys once in a while after trying clients.