News for hackers. Stuff that matters.

A comment on Show HN: Open-source engine running Gemma 4 26B in 2 GB RAM on any M-series Mac. Parent comment

Re:Show HN: Open-source engine running Gemma 4 26B in 2 GB R... by giancarlostoro on Wednesday July 29, 2026 @03:39PM (#49102019)
I assume it will get better over time, and does it improve in speed if you use a larger buffer? Say instead of 2GB you go with 6GB? I imagine it would, and you might need to stream drastically less no?
[ Parent | on HN ]
Re:Show HN: Open-source engine running Gemma 4 26B in 2 GB R... by gitpusher42 on Wednesday July 29, 2026 @03:54PM (#49102201)
Yeah, correct! You can set up this engine to get more expert cache slots (e.g 32 instead of 16) to get a better hit rate and better tok/s. it will be 3.5gb instead of 2gb.
[ Parent | on HN ]