2) If you're privacy first, many would feel a lot more comfortable if this was released as an app in the app store so it will be sandboxed. This is important because it's not open source so we have no idea what is happening in the background. Alternatively open source it, which many here have requested.
https://github.com/open-webui/open-webui
a well featured UI with very active team
Offline isn’t important for me, only that $20 is a lot of money, when I’d wager most months my usage is a lot less. However, I’d still want access to completion, DALL-E, etc.
Would Msty be a good option for me?
It loads the LLM in the browser, using webgpu, so it works offline after the first load, it's also PWA you can install. It should work on chrome > 113 on desktop and chrome > 121 on mobile.
Incidentally, it currently runs Mixtral 8x7B Instruct[2] and Mistral[3] models faster than any other macOS app. The comparison videos are with Ollama, but it generalizes well to almost every other macOS app that I've seen uses llama.cpp for inference. :)
nb: Mixtral 8x7B Instruct requires an Apple Silicon Mac with at least 32GB of RAM.
- https://github.com/nomic-ai/gpt4all
- https://github.com/imartinez/privateGPT
- https://github.com/oobabooga/text-generation-webui
- https://github.com/FlowiseAI/Flowise
- https://github.com/lobehub/lobe-chat
- https://github.com/PromtEngineer/localGPT
- https://github.com/h2oai/h2ogpt
- https://github.com/huggingface/chat-ui
- https://github.com/SillyTavern/SillyTavern
- https://github.com/ollama-webui/ollama-webui
- https://github.com/Chainlit/chainlit
Seems to have more features than all of them
Was testing apps like this if anyone is interested:
Best / Easy to use:
- https://lmstudio.ai
- https://msty.app
- https://jan.ai
More complex / Unpolished UI:
- https://gpt4all.io
- https://pinokio.computer
- https://www.nvidia.com/en-us/ai-on-rtx/chat-with-rtx-generat...
- https://github.com/LostRuins/koboldcpp
Misc:
- https://faraday.dev (AI Characters):
No UI / Command line (not for me):
- https://ollama.com
- https://privategpt.dev
- https://serge.chat
- https://github.com/Mozilla-Ocho/llamafile
Pending to check:
- https://recurse.chat
Feel free to recommend more!