Re:Mixtral 8x7B: A sparse Mixture of Experts language model
by Casteil on Tuesday January 09, 2024 @11:52AM
(#38928377)
Ollama[1] + Ollama WebUI[2] is a killer combination for offline/fully local LLMs. Takes all the pain out of getting LLMs going. Both projects are rapidly adding functionality including recent addition of multimodal support.
[1] https://github.com/jmorganca/ollama
[2] https://github.com/ollama-webui/ollama-webui