Re:Ollama has a native front end chatbot now
by jerieljan on Thursday July 31, 2025 @06:30AM
(#44744207)
The trick to this is to run a LiteLLM proxy that has all the connections to whatever you need to connect to and then point Open-WebUI to that.
I've been using this setup for several months now (over a year?) and it's very effective.
The proxy also benefits pretty much any other application you have that recognizes an OpenAI-compatible API. (Or even if it doesn't)
Is this easier now? Specifically, I would like to easily connect anthropic models just by plugging in my API key.