Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Mlx-community/OLMo-2-0325-32B-Instruct-4bit.
max_rec_size = mx.metal.device_info()["max_recommended_working_set_size"]
RuntimeError: [metal::device_info] Cannot get device info without metal backend
Because it is accompanied with a huge stacktrace, it makes me think this is a genuine bug and I hope Simon will fix it.
My plugin only works on Apple Silicon.
max_rec_size = mx.metal.device_info()["max_recommended_working_set_size"]
RuntimeError: [metal::device_info] Cannot get device info without metal backend
Because it is accompanied with a huge stacktrace, it makes me think this is a genuine bug and I hope Simon will fix it.