News for hackers. Stuff that matters.

A comment on The RAM shortage comes for us all. Parent comment

Re:The RAM shortage comes for us all by irthomasthomas on Friday December 05, 2025 @11:57AM (#46163926)
Not exactly. MoE uses a router model to select a subset of layers per token. This makes them faster but still requires the same amount of RAM.
[ Parent | on HN ]

There are no comments on this comment yet.