News for hackers. Stuff that matters.
Re:Run Llama 2 Uncensored Locally by fprotthetarball on Wednesday August 02, 2023 @07:22PM (#36979274)
Ollama is the best I have seen if you want to play around with LLMs.

After installing the application and running it, you run "ollama run <model name>" and it handles everything and drops you into a chat with the LLM. There are no dependencies for you to manage -- just one application.

Check out the README: https://github.com/jmorganca/ollama#readme

There are no comments on this comment yet.