News for hackers. Stuff that matters.

A comment on GLM-4.7.

Re:GLM-4.7 by ethmarks on Monday December 22, 2025 @01:21PM (#46356963)
Huggingface[0] says that this is a 358B model. What kind of hardware is necessary to run it?

[0]: https://huggingface.co/zai-org/GLM-4.7

[ Parent | on HN ]
Re:GLM-4.7 by rz2k on Monday December 22, 2025 @01:39PM (#46357208)
It is a mixture of experts model so it will run on a computer with a lot of RAM and a GPU.

Alternately, on an M3 Ultra Mac Studio with 256GB of unified memory, you can run a 4bit quant of GLM-4.6 at about 20 tokens/second. That compares to about 40 t/s for a 6bit quant of MiniMax M2. I am not sure how fast these will run if you have a Mac Studio 512GB that can load the unquantized versions of the models.

[ Parent | on HN ]