News for hackers. Stuff that matters.

A comment on Llamafile is the new best way to run a LLM on your own computer. Parent comment

Re:Llamafile is the new best way to run a LLM on your own co... by breckenedge on Friday December 01, 2023 @03:02PM (#38491520)
Per the article:

> You can also download a much smaller llamafile binary from their releases, which can then execute any model that has been compiled to GGUF format

[ Parent | on HN ]
Re:Llamafile is the new best way to run a LLM on your own co... by dragonwriter on Friday December 01, 2023 @07:17PM (#38494429)
Or you can download LM Studio or oobabooga and execute any model compiled to GGUF format, and also models in a wide variety of formats that aren't GGUF.
[ Parent | on HN ]