News for hackers. Stuff that matters.

A comment on iPhone 17 Pro Demonstrated Running a 400B LLM. Parent comment

Re:iPhone 17 Pro Demonstrated Running a 400B LLM by stingraycharles on Tuesday March 24, 2026 @01:43PM (#47506431)
Ok I am by no means an expert on this and I immediately stand corrected. But as I understand it, in order to understand the amount of active memory that’s required, it’s more accurate to go by the ~82B number, right?
[ Parent | on HN ]
Re:iPhone 17 Pro Demonstrated Running a 400B LLM by zozbot234 on Tuesday March 24, 2026 @02:36PM (#47507173)
The ~82B figure is an attempt to compare performance to an equivalent dense model. The amount of active parameters is given by the ~17B.
[ Parent | on HN ]