Re:Ollama is now powered by MLX on Apple Silicon in preview
by roboror on Tuesday March 31, 2026 @02:13PM
(#47591338)
What models have you found capable? I was recently recommended Qwen3 Coder Next and I did not find it very successful. I have a good amount of VRAM/RAM so would love to run something locally.
Re:Ollama is now powered by MLX on Apple Silicon in preview
by testing22321 on Tuesday March 31, 2026 @05:36PM
(#47593779)
Thanks.
I still don’t understand. What are you using this long you’re running locally to actually do?
What is the use case?
None of them are as good as the big hosted models, but you might be surprised at how capable they are. I like running things locally when I can, and I also like not worrying about accidentally burning through tokens.
I think the future is multiple locally run models that call out to hosted models when necessary. I can imagine every device coming with a base model and using loras to learn about the users needs. With companies and maybe even households having their own shared models that do heavier lifting. while companies like openai and anhtropic continue to host the most powerful and expensive options.