News for hackers. Stuff that matters.

A comment on Llamafile lets you distribute and run LLMs with a single file. Parent comment

Re:Llamafile lets you distribute and run LLMs with a single ... by stevenhuang on Wednesday November 29, 2023 @05:07PM (#38465981)
The binaries themselves are available standalone https://github.com/Mozilla-Ocho/llamafile/releases
[ Parent | on HN ]
Re:Llamafile lets you distribute and run LLMs with a single ... by rgbrgb on Wednesday November 29, 2023 @06:59PM (#38467236)
cool. this is more convenient than my workflow for doing the binaries myself. I currently use make to generate a binary of llama.cpp server on my intel iMac and my m1 MacBook then lipo them together.
[ Parent | on HN ]