Re:Show HN: Open-source engine running Gemma 4 26B in 2 GB R...
by gopalv on Wednesday July 29, 2026 @02:36PM
(#49101298)
> It always felt as though we already figured out how to break up large files and parse them efficiently with very little memory.
The A in 26B-A4B is the active weights.
The problem is that this is a per-token load/unload at best, not for the whole prompt.
The division happened until one of these can fit in a single GPU and they stopped scaling it down any more, because you can wire up 8 of them to do their share of the work.
The A in 26B-A4B is the active weights.
The problem is that this is a per-token load/unload at best, not for the whole prompt.
The division happened until one of these can fit in a single GPU and they stopped scaling it down any more, because you can wire up 8 of them to do their share of the work.