News for hackers. Stuff that matters.
Re:Mlx-community/OLMo-2-0325-32B-Instruct-4bit by bmn__ on Tuesday March 18, 2025 @06:29AM (#43397718)
The download-model step breaks with:

max_rec_size = mx.metal.device_info()["max_recommended_working_set_size"]

RuntimeError: [metal::device_info] Cannot get device info without metal backend

Because it is accompanied with a huge stacktrace, it makes me think this is a genuine bug and I hope Simon will fix it.

Re:Mlx-community/OLMo-2-0325-32B-Instruct-4bit by simonw on Tuesday March 18, 2025 @08:59AM (#43398920)
What hardware are you using?

My plugin only works on Apple Silicon.