Re:LLaMA Now Goes Faster on CPUs
by samus on Monday April 01, 2024 @04:39AM
(#39891945)
I don't necessarily agree. It requires massive computing power, but running models smaller than 70G parameters is possible on consumer hardware, albeit slowly.
[ Parent
| on HN ]
Re:LLaMA Now Goes Faster on CPUs
by threecheese on Monday April 01, 2024 @06:31PM
(#39900176)
Parent may be thinking more along the lines of a “hope we can print all the knowledge“ type catastrophe. Though if there is zero compute it’ll be tough reading all those disks!