News for hackers. Stuff that matters.

A comment on Run Llama 2 Uncensored Locally. Parent comment

Re:Run Llama 2 Uncensored Locally by nottorp on Wednesday August 02, 2023 @06:02PM (#36978311)
Is there some kind of tutorial for installing these (and their dependencies) somewhere?

One that assumes i can set up python modules and compile stuff but i have no idea about all these LLM libraries would be enough thank you.

[ Parent | on HN ]
Re:Run Llama 2 Uncensored Locally by fprotthetarball on Wednesday August 02, 2023 @07:22PM (#36979274)
Ollama is the best I have seen if you want to play around with LLMs.

After installing the application and running it, you run "ollama run <model name>" and it handles everything and drops you into a chat with the LLM. There are no dependencies for you to manage -- just one application.

Check out the README: https://github.com/jmorganca/ollama#readme

[ Parent | on HN ]
Re:Run Llama 2 Uncensored Locally by gnicholas on Wednesday August 02, 2023 @08:56PM (#36979965)
Ollama is pretty dead simple, with no dependencies to manage. I just didn’t realize I needed to open the app when using it via the terminal, and it sounds like even this wrinkle will be smoothed out soon.

I’m a non-technical founder so if I can do it, pretty much and HNer should be able to do so!

[ Parent | on HN ]