News for hackers. Stuff that matters.

A comment on Run a 1T parameter model on a 32gb Mac by streaming tensors from NVMe. Parent comment

Re:Run a 1T parameter model on a 32gb Mac by streaming tenso... by hrmtst93837 on Tuesday March 24, 2026 @03:32PM (#47507860)
People talk about "SSD endurance", but enough parallel I/O on M1/M2 can make the NVMe controller choke, with very weird latncy spikes.
[ Parent | on HN ]

There are no comments on this comment yet.