Re:Llamafile – The easiest way to run LLMs locally on your Mac
by paolop on Monday December 04, 2023 @07:52PM
(#38525612)
Totally agreed it's not yet ideal - absolutely. But I feel we are expanding the pie of users with this step, which is just an intermediate step.
Do you want to work on that packaging ;-)?
Open terminal
curl -LO https://huggingface.co/jartine/llava-v1.5-7B-GGUF/resolve/ma...
chmod 755 …
./…
Open localhost:8080 in browser
To make this accessible to a broader cohort you would package it into an app and put it somewhere with provenance, eg. A well known GitHub account or App Store.
The solution, as shown, doesn’t solve either of the problems you’ve said are problems it attempts to solve.
It is a bad solution.