News for hackers. Stuff that matters.

A comment on Run a 1T parameter model on a 32gb Mac by streaming tensors from NVMe. Parent comment

Re:Run a 1T parameter model on a 32gb Mac by streaming tenso... by Insanity on Tuesday March 24, 2026 @01:05PM (#47505853)
I had assumed heat generation on the controller if it's continuously reading. But maybe it's not actually bad.
[ Parent | on HN ]
Re:Run a 1T parameter model on a 32gb Mac by streaming tenso... by throwway120385 on Tuesday March 24, 2026 @01:45PM (#47506460)
Just pop a heatsink on it and call it good.
[ Parent | on HN ]