Re:Llamafile lets you distribute and run LLMs with a single ...
by dws on Wednesday November 29, 2023 @10:01PM
(#38468927)
Can confirm that this runs on an ancient i3 NUC under Ubuntu 20.04. It emits a token every five or six seconds, which is "ask a question then go get coffee" speed. Still, very cool.
[ Parent
| on HN ]
There are no comments on this comment yet.