Re:M5 Ultra Mac Studio Review: The Dream Mac for Local AI Ag...
by alex7o on Monday September 21, 2026 @01:24PM
(#49790334)
On my m5 max 27b model does 75tps on 256k ctx and starts at 80 on the 8k ctx when you add https://huggingface.co/collections/z-lab/dflash-2 to it. So yeah base might be 30tps (I used iq4) but mtp or dflash help a lot and should be used when checking what is useful and what is not for running models as it is not fare to judge without them.
[ Parent
| on HN ]
There are no comments on this comment yet.