News for hackers. Stuff that matters.
Re:Llamafile lets you distribute and run LLMs with a single ... by anonzzzies on Thursday November 30, 2023 @01:41AM (#38470440)
Very nice; works perfect on Ubuntu 20.04. Doing 8 tokens/s on a pretty crappy server.
Re:Llamafile lets you distribute and run LLMs with a single ... by belter on Thursday November 30, 2023 @04:50AM (#38471609)
Perfectly on Fedora 39 on old ( and I mean old...) machines. This is actually shocking...shocking good...