Ollama with WebUI https://github.com/open-webui/open-webui
Not sure why your comment was downvoted. ^ is absolutely the right answer.
Open WebUI is functionally identical to the ChatGPT interface. You can even use it with the OpenAI APIs to have your own pay per use GPT 4. I did this.
Re:Mixtral 8x22B
by lubesGordi on Wednesday April 17, 2024 @02:35PM
(#40068517)
Hey can you guys elaborate how this works? I'm looking at the Ollama section in their docs and it talks about load balancing? I don't understand what that means in this context.
Re:Mixtral 8x22B
by SushiHippie on Wednesday April 17, 2024 @11:16PM
(#40072627)
You probably want to look at the getting started guide
https://docs.openwebui.com/getting-started/
IIUC the load balancing page is for people who want to run openwebui at a larger scale
You can try Msty as well. I am the author.
I've tried LMStudio, but I'm not a fan of the interface compared to OpenAI's. The lack of automatic regeneration every time I edit my input, like on ChatGPT, is quite frustrating. I also gave Ollama a shot, but using the CLI is less convenient.
Ideally, I'd like something that allows me to edit my settings quite granularly, similar to what I can do in OpenLM, with the QoL from the hosted online platforms, particularly the ease of editing my prompts that I use extensively.