News for hackers. Stuff that matters.

A comment on Llamafile is the new best way to run a LLM on your own computer.

Re:Llamafile is the new best way to run a LLM on your own co... by leonidbelyaev on Friday December 01, 2023 @03:15PM (#38491696)
Doesn't work on my NixOS workstation.
[ Parent | on HN ]
Re:Llamafile is the new best way to run a LLM on your own co... by SkyMarshal on Friday December 01, 2023 @03:37PM (#38491991)
Why not, what’s the error, and how did you set it up? Any chance you tried it in a nix shell or nix vm or other isolated environment?
[ Parent | on HN ]
Re:Llamafile is the new best way to run a LLM on your own co... by psanford on Friday December 01, 2023 @04:01PM (#38492312)
It fails because it hardcodes the path to certain binaries instead of looking in PATH: `line 60: /bin/mkdir: No such file or directory`
[ Parent | on HN ]
Re:Llamafile is the new best way to run a LLM on your own co... by SkyMarshal on Friday December 01, 2023 @05:35PM (#38493504)
Oh lol, I've never heard of /bin/mkdir even on regular FHS linuxes. Is that actually a thing?
[ Parent | on HN ]
Re:Llamafile is the new best way to run a LLM on your own co... by FragenAntworten on Friday December 01, 2023 @04:05PM (#38492380)
See this comment from the other discussion: https://news.ycombinator.com/item?id=38469749
[ Parent | on HN ]