News for hackers. Stuff that matters.

A comment on Towards 1-bit Machine Learning Models. Parent comment

Re:Towards 1-bit Machine Learning Models by quentinp on Friday March 29, 2024 @01:28PM (#39866712)
Actually they plan to put an LLM in your back pocket using flash memory, not silicon: https://arxiv.org/abs/2312.11514
[ Parent | on HN ]
Re:Towards 1-bit Machine Learning Models by declaredapple on Friday March 29, 2024 @01:49PM (#39866942)
The flash doesn't do the computations though, that's just a method of getting it to the processor
[ Parent | on HN ]
Re:Towards 1-bit Machine Learning Models by sroussey on Friday March 29, 2024 @04:19PM (#39868568)
It would be better to have eeprom or some such directly attached as memory. No loading.
[ Parent | on HN ]