News for hackers. Stuff that matters.
Re:Ollama is now powered by MLX on Apple Silicon in preview by LuxBennu on Wednesday April 01, 2026 @03:25AM (#47597922)
that tracks with what i've noticed practically. shorter prompts feel basically the same between llama.cpp metal and what i'd expect from native mlx, but once context gets longer the overhead starts showing up. would be interesting to see if ollama's mlx path actually handles kv cache differently under the hood or if it just skips the buffer sync layer
Re:Ollama is now powered by MLX on Apple Silicon in preview by zozbot234 on Wednesday April 01, 2026 @04:06AM (#47598169)
If it's just about skipping some buffer sync that's something that could also be adopted by llama.cpp's own Metal backend, at least on Apple Silicon platforms.