Re:Llamafile lets you distribute and run LLMs with a single ...
by anonzzzies on Thursday November 30, 2023 @01:41AM
(#38470440)
Very nice; works perfect on Ubuntu 20.04. Doing 8 tokens/s on a pretty crappy server.
[ Parent
| on HN ]