News for hackers. Stuff that matters.
Re:Apple discontinues the Mac Pro with no plans for future h... by zozbot234 on Sunday March 29, 2026 @08:07PM (#47568844)
I think the advantage of Flash-MoE compared to plain mmap is mostly the coalesced representation where a single expert-layer is represented by a single extent of sequential data. That could be introduced to existing binary formats like GGUF or HF - there is already a provision for differently structured representations, and that would easily fit.

There are no comments on this comment yet.