Re:iPhone 17 Pro Demonstrated Running a 400B LLM
by ottah on Monday March 23, 2026 @12:42PM
(#47491897)
I mean, by any reasonable standard it still is. Almost any computer can run an llm, it's just a matter of how fast, and 0.4k/s (peak before first token) is not really considered running. It's a demo, but practically speaking entirely useless.
[ Parent
| on HN ]
Re:iPhone 17 Pro Demonstrated Running a 400B LLM
by alephnerd on Monday March 23, 2026 @01:14PM
(#47492317)
Devils advocate - this actually shows how promising TinyML and EdgeML capabilities are. SoCs comparable to the A19 Pro are highly likely to be commodified in the next 3-5 years in the same manner that SoCs comparable to the A13 already are.