Re:Llamafile lets you distribute and run LLMs with a single ...
by stavros on Wednesday November 29, 2023 @08:35PM
(#38468078)
That worked, thanks Justine! I use fish, so I didn't get a zsh error, but I had missed the Gotchas section (and the README), so this helps!
[ Parent
| on HN ]
Re:Llamafile lets you distribute and run LLMs with a single ...
by jart on Wednesday November 29, 2023 @08:40PM
(#38468124)
Fish is another cool shell I got to help improve two years ago by upstreaming a patch for this. So long as you're using a recent version, you should be golden (provided binfmt_misc doesn't cause any issues). Let us know what you think of llamafile!
Re:Llamafile lets you distribute and run LLMs with a single ...
by stavros on Sunday December 03, 2023 @05:07PM
(#38511219)
Thank you, I really like it! It's a very clever way to get LLMs deployed, and with Cosmopolitan, I don't need to point people to different downloads for the same LLM. Excellent job.