News for hackers. Stuff that matters.
Re:Ask HN: If you're running an LLM locally, what are you us... by nomilk on Wednesday February 07, 2024 @01:31PM (#39292295)
Got it working. Was easy to install on macOS just an .app file to download, and one line in the terminal to download the 3.8GB manifest. Took 44 minutes from making this post (35 minutes from your reply). Seems to work quite well (quite a lot faster than ChatGPT, but perhaps not as high quality, at least based on some of the leaderboards I've been perusing).

I added this web ui mostly to render code chunks nicely for easy copy/paste (web UI found via the readme): https://github.com/ivanfioravanti/chatbot-ollama

Getting chatgpt-like UX. Love that I can put in a system prompt so easily (if desired).

There are no comments on this comment yet.