News for hackers. Stuff that matters.
Re:Llamafile lets you distribute and run LLMs with a single ... by dws on Wednesday November 29, 2023 @10:01PM (#38468927)
Can confirm that this runs on an ancient i3 NUC under Ubuntu 20.04. It emits a token every five or six seconds, which is "ask a question then go get coffee" speed. Still, very cool.

There are no comments on this comment yet.