News for hackers. Stuff that matters.

A comment on iPhone 17 Pro Demonstrated Running a 400B LLM. Parent comment

Re:iPhone 17 Pro Demonstrated Running a 400B LLM by intrasight on Monday March 23, 2026 @12:26PM (#47491672)
I think for many reasons this will become the dominant paradigm for end user devices.

Moore's law will shrink it to 8mm soon. I think it'll be like a microSD card you plug in.

Or we develop a new silicon process that can mimic synaptic weights in biology. Synapses have plasticity.

[ Parent | on HN ]
Re:iPhone 17 Pro Demonstrated Running a 400B LLM by bigyabai on Monday March 23, 2026 @12:30PM (#47491729)
One big bottleneck is SRAM cost. Even an 8b model would probably end up being hundreds of dollars to run locally on that kind of hardware. Especially unpalatable if the model quality keeps advancing year-by-year.

> Or we develop a new silicon process that can mimic synaptic weights in biology. Synapses have plasticity.

It's amazing to me that people consider this to be more realistic than FAANG collaborating on a CUDA-killer. I guess Nvidia really does deserve their valuation.

[ Parent | on HN ]
Re:iPhone 17 Pro Demonstrated Running a 400B LLM by intrasight on Monday March 23, 2026 @12:48PM (#47491962)
> bottleneck is SRAM cost

Not for this approach

[ Parent | on HN ]