News for hackers. Stuff that matters.
Re:iPhone 17 Pro Demonstrated Running a 400B LLM by skiing_crawling on Monday March 23, 2026 @02:20PM (#47493222)
I can't understand why this is a surprise to anyone. An iphone is still a computer, of course it can run any model that fits in storage albiet very slowly. The implementation is impressive I guess but I don't see how this is a novel capability. And for 0.6t/s, its not a cost efficient hardware for doing it. The iphone can also render pixar movies if you let it run long enough, mine bitcoin with a pathetic hashrate, and do weather simulations but not in time for the forecast to be relevant.
Re:iPhone 17 Pro Demonstrated Running a 400B LLM by anemll on Monday March 23, 2026 @02:40PM (#47493458)
SSD streaming to compute units is new. M4 max can do 15 t/s with its 15GB/s drives
Re:iPhone 17 Pro Demonstrated Running a 400B LLM by bigyabai on Monday March 23, 2026 @07:03PM (#47496315)
It was "new" in 2019. The PS5 and Xbox Series X both shipped with GPUDirect Storage, and even most dGPUs support it via ReBAR/RDMA nowadays.