Re:LLaMA Now Goes Faster on CPUs
by etc-hosts on Sunday March 31, 2024 @11:10PM
(#39890577)
https://justine.lol/oneliners/
[ Parent
| on HN ]
Re:LLaMA Now Goes Faster on CPUs
by threecheese on Monday April 01, 2024 @06:37PM
(#39900222)
This looks amazing, but the docs mention .llamafiles exceed the Windows executable size limit, and there are workarounds to externalize the weights. Do you think this is an impediment to its becoming popular? Or is MS consumer hardware just far enough behind (w/o dedi gpu) that “there’s time”?