News for hackers. Stuff that matters.
Re:Ollama is now powered by MLX on Apple Silicon in preview by dec0dedab0de on Tuesday March 31, 2026 @11:18AM (#47588620)
most of the llm tooling can handle different models. Ollama makes it easy to install and run different models locally. So you can configure aider or vscode or whatever you're using to connect to chatgpt to point to your local models instead.

None of them are as good as the big hosted models, but you might be surprised at how capable they are. I like running things locally when I can, and I also like not worrying about accidentally burning through tokens.

I think the future is multiple locally run models that call out to hosted models when necessary. I can imagine every device coming with a base model and using loras to learn about the users needs. With companies and maybe even households having their own shared models that do heavier lifting. while companies like openai and anhtropic continue to host the most powerful and expensive options.

Re:Ollama is now powered by MLX on Apple Silicon in preview by roboror on Tuesday March 31, 2026 @02:13PM (#47591338)
What models have you found capable? I was recently recommended Qwen3 Coder Next and I did not find it very successful. I have a good amount of VRAM/RAM so would love to run something locally.
Re:Ollama is now powered by MLX on Apple Silicon in preview by testing22321 on Tuesday March 31, 2026 @05:36PM (#47593779)
Thanks.

I still don’t understand. What are you using this long you’re running locally to actually do?

What is the use case?