News for hackers. Stuff that matters.

A comment on Show HN: Open-source engine running Gemma 4 26B in 2 GB RAM on any M-series Mac. Parent comment

Re:Show HN: Open-source engine running Gemma 4 26B in 2 GB R... by nijave on Thursday July 30, 2026 @07:19AM (#49108460)
>So, if software knows in advance which data chunk (expert) it'll need for the next token, it can load that in parallel with computing current token.

Yeah, I was thinking MADV_WILLNEED might work there but not sure

[ Parent | on HN ]

There are no comments on this comment yet.