Re:iPhone 17 Pro Demonstrated Running a 400B LLM
by anemll on Monday March 23, 2026 @02:39PM
(#47493446)
Yes, SSD speed is critical though. The repo has macOS builds for CLI and Desktop.
It's early stages though. M4 Max gets 10-15 TPS on 400B depending on quantization. Compute is an issue too; a lot of code is PoC level.
[ Parent
| on HN ]
There are no comments on this comment yet.