News for hackers. Stuff that matters.
Re:Llamafile lets you distribute and run LLMs with a single ... by column on Thursday November 30, 2023 @02:48AM (#38470834)
This is for convenience. You can also download a 4.45Mb executable (llamafile-server-0.1) and pass any GGUF model as an argument.

> llamafile-server-0.1 -m llama-2-13b.Q8_0.gguf

https://github.com/Mozilla-Ocho/llamafile/releases/tag/0.1

There are no comments on this comment yet.