Re:Llamafile lets you distribute and run LLMs with a single ...
by getwiththeprog on Thursday November 30, 2023 @05:30AM
(#38471884)
makes one think that perhaps Apple isn't a good long term choice...
Re:Llamafile lets you distribute and run LLMs with a single ...
by pmarreck on Thursday November 30, 2023 @08:41AM
(#38473387)
Apple is a fine long-term choice (speaking as a recent linux advocate actually, lol). But that computer is 12 years old
Re:Llamafile lets you distribute and run LLMs with a single ...
by interfixus on Thursday November 30, 2023 @09:48AM
(#38474168)
So what? This crazy thing runs fine, albeit slowly, on my 12 year old ThinkPad. It's actually digesting an image of an anteater while I write this. Because of course it plays nicely and doesn't hog the hardware.
All the new AI toys especially seem to love beefy newish hardware and especially GPU hardware if available