Re:Antirez/h3.c: MiniMax H3 inference engine for Mac computers
by vimto on Tuesday August 11, 2026 @07:14AM
(#49256382)
GGUF is outdated in the latest versions of Comfy-UI. If you want a good balance of size, speed and quality you should use the int8_convrot model from the official Comfy Org Repo https://huggingface.co/Comfy-Org/MiniMax-H3/tree/main/diffus...
[ Parent
| on HN ]
Re:Antirez/h3.c: MiniMax H3 inference engine for Mac computers
by Meleagris on Tuesday August 11, 2026 @10:19AM
(#49258842)
So I did test this, and it doesn't work because the quantized layers need torch._int_mm, which PyTorch's MPS backend doesn't implement. It just throws NotImplementedError.
Re:Antirez/h3.c: MiniMax H3 inference engine for Mac computers
by SV_BubbleTime on Tuesday August 11, 2026 @11:39AM
(#49260035)
This is good advice if you have nvidia, but for Mac does not apply currently.
Re:Antirez/h3.c: MiniMax H3 inference engine for Mac computers
by dragonwriter on Tuesday August 11, 2026 @12:05PM
(#49260393)
GGUF is unsupported by ComfyUI’s memory management system that enables running models much larger than fit in VRAM with tolerable efficiency via weight streaming, but for unified memory systems that system is less relevant (unless using models too big to run in unified memory AND having fast enough mass storage to benefit from direct-from-disk weight streaming.)