Re:Apple discontinues the Mac Pro with no plans for future h...
by gloxkiqcza on Sunday March 29, 2026 @11:23AM
(#47563935)
You can do this on a Mac as well tho, right? So that 128 GB unified memory becomes cache for very fast 1+ TB Apple SSD.
[ Parent
| on HN ]
Re:Apple discontinues the Mac Pro with no plans for future h...
by zozbot234 on Sunday March 29, 2026 @08:07PM
(#47568844)
I think the advantage of Flash-MoE compared to plain mmap is mostly the coalesced representation where a single expert-layer is represented by a single extent of sequential data. That could be introduced to existing binary formats like GGUF or HF - there is already a provision for differently structured representations, and that would easily fit.