Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Llamafile is the new best way to run a LLM on your own computer. Parent comment
- Download and launch the app
- Use their interface to huggingface models, download the one you want
- Go to the chat window and select load
- Chat away w/ a ChatGPT like interface that includes markdown processing and easy copying of code blocks, etc
Outside of the time to download a model, it's about 30 seconds of work to get up and running
There are no comments on this comment yet.
- Download and launch the app
- Use their interface to huggingface models, download the one you want
- Go to the chat window and select load
- Chat away w/ a ChatGPT like interface that includes markdown processing and easy copying of code blocks, etc
Outside of the time to download a model, it's about 30 seconds of work to get up and running