News for hackers. Stuff that matters.
Re:M5 Ultra Mac Studio Review: The Dream Mac for Local AI Ag... by alex7o on Monday September 21, 2026 @01:24PM (#49790334)
On my m5 max 27b model does 75tps on 256k ctx and starts at 80 on the 8k ctx when you add https://huggingface.co/collections/z-lab/dflash-2 to it. So yeah base might be 30tps (I used iq4) but mtp or dflash help a lot and should be used when checking what is useful and what is not for running models as it is not fare to judge without them.

There are no comments on this comment yet.