News for hackers. Stuff that matters.
Re:Llamafile is the new best way to run a LLM on your own co... by jawilson on Tuesday December 05, 2023 @01:01AM (#38527594)
It would be nice if input could be taken from a command line argument or better yet, stdin so that it is fully scriptable.

ollama has a way to do this and lets you play with a bunch of models without being very smart (just do ollama pull <model-name> and it downloads a model and makes it available to ollama run/ollama serve).

(Sounds like I also need to play with LM Studio).

There are no comments on this comment yet.