News for hackers. Stuff that matters.

A comment on iPhone 17 Pro Demonstrated Running a 400B LLM. Parent comment

Re:iPhone 17 Pro Demonstrated Running a 400B LLM by 3abiton on Monday March 23, 2026 @05:18PM (#47495244)
To be fair, it's "possible" to run such setup with llama.cpp with ssd offload. It's just abysmal TG speeds. But it's possible.
[ Parent | on HN ]

There are no comments on this comment yet.