Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Show HN: Open-source engine running Gemma 4 26B in 2 GB RAM on any M-series Mac. Parent comment
Time to 1st token is faster on the M5 because of HW accelerators helping the prompt interpretation (and it is CPU-bound).
Token generation after that is GPU-bound and will profit from the higher bandwidth of the M4 Max.
There are no comments on this comment yet.
Time to 1st token is faster on the M5 because of HW accelerators helping the prompt interpretation (and it is CPU-bound).
Token generation after that is GPU-bound and will profit from the higher bandwidth of the M4 Max.