News for hackers. Stuff that matters.

A comment on Llamafile lets you distribute and run LLMs with a single file. Parent comment

Re:Llamafile lets you distribute and run LLMs with a single ... by lordfrikk on Thursday November 30, 2023 @05:54AM (#38471995)
On a fresh install of Ubuntu 23.10, I made it executable (`chmod +x llamafile`) and it worked just like that. After installing `nvidia-cuda-toolkit` it also worked with my GPU. So far the most seamless method I've tried.
[ Parent | on HN ]

There are no comments on this comment yet.