News for hackers. Stuff that matters.

A comment on Show HN: Open-source engine running Gemma 4 26B in 2 GB RAM on any M-series Mac. Parent comment

Re:Show HN: Open-source engine running Gemma 4 26B in 2 GB R... by fouc on Wednesday July 29, 2026 @10:00PM (#49105337)
M4 Max is typically better than M5 Pro for inference IIRC.
[ Parent | on HN ]
Re:Show HN: Open-source engine running Gemma 4 26B in 2 GB R... by harrouet on Thursday July 30, 2026 @04:06AM (#49107218)
It depends on what you are looking at.

Time to 1st token is faster on the M5 because of HW accelerators helping the prompt interpretation (and it is CPU-bound).

Token generation after that is GPU-bound and will profit from the higher bandwidth of the M4 Max.

[ Parent | on HN ]