News for hackers. Stuff that matters.
Re:iPhone 17 Pro Demonstrated Running a 400B LLM by superxpro12 on Monday March 23, 2026 @01:46PM (#47492750)
Sounds like just the sort of thing FGPA's were made for.

The $$$ would probably make my eyes bleed tho.

Re:iPhone 17 Pro Demonstrated Running a 400B LLM by chrsw on Monday March 23, 2026 @02:04PM (#47493006)
Current FPGAs would have terrible performance. We need some new architecture combining ASIC LLM perf and sparse reconfiguration support maybe.
Re:iPhone 17 Pro Demonstrated Running a 400B LLM by 0x457 on Monday March 23, 2026 @02:49PM (#47493575)
Wouldn't it be the opposite of freezing weights?