News for hackers. Stuff that matters.
Re:Ollama is now powered by MLX on Apple Silicon in preview by sowbug on Tuesday March 31, 2026 @01:26PM (#47590694)
I am concerned that local models will never benefit from the training on live requests that is surely improving cloud-only models.

This might be the cost of privacy, and it might be worth paying, unless cloud models reach an inflection point that make local models archaic.

Re:Ollama is now powered by MLX on Apple Silicon in preview by port11 on Sunday April 05, 2026 @12:05PM (#47650797)
There’s been some success training models on top of differential privacy.

I imagine that with live requests it would be quite challenging but not impossible, assuming you could somehow sanitize all sorts of private data that people throw at these prompts.