News for hackers. Stuff that matters.

A comment on Mixtral 8x7B: A sparse Mixture of Experts language model. Parent comment

Re:Mixtral 8x7B: A sparse Mixture of Experts language model by vunderba on Tuesday January 09, 2024 @03:01AM (#38923567)
I wouldn't use Ollama (or any LLM host) through docker on Mac m1 since as far as I'm aware there's still no support for Metal.
[ Parent | on HN ]
Re:Mixtral 8x7B: A sparse Mixture of Experts language model by Luc on Tuesday January 09, 2024 @04:21AM (#38923989)
The UI is in Docker but the Ollama server isn't.
[ Parent | on HN ]