News for hackers. Stuff that matters.
Re:Run Llama 2 Uncensored Locally by gnicholas on Wednesday August 02, 2023 @01:58PM (#36974460)
I have downloaded and run ollama successfully on my Mac in the past, but when I try to run one of these commands, it doesn't work (connection refused). What am I doing wrong?
Re:Run Llama 2 Uncensored Locally by mchiang on Wednesday August 02, 2023 @02:00PM (#36974509)
This is usually because the Ollama server isn't running. To solve it either:

- Start the Ollama app (which will run the Ollama server)

- Open terminal: `ollama serve` to start the server.

We'll fix this in the upcoming release

Re:Run Llama 2 Uncensored Locally by gnicholas on Wednesday August 02, 2023 @03:27PM (#36975883)
Ah, perfect, thanks!
Re:Run Llama 2 Uncensored Locally by nottorp on Wednesday August 02, 2023 @06:02PM (#36978311)
Is there some kind of tutorial for installing these (and their dependencies) somewhere?

One that assumes i can set up python modules and compile stuff but i have no idea about all these LLM libraries would be enough thank you.

Re:Run Llama 2 Uncensored Locally by fprotthetarball on Wednesday August 02, 2023 @07:22PM (#36979274)
Ollama is the best I have seen if you want to play around with LLMs.

After installing the application and running it, you run "ollama run <model name>" and it handles everything and drops you into a chat with the LLM. There are no dependencies for you to manage -- just one application.

Check out the README: https://github.com/jmorganca/ollama#readme

Re:Run Llama 2 Uncensored Locally by gnicholas on Wednesday August 02, 2023 @08:56PM (#36979965)
Ollama is pretty dead simple, with no dependencies to manage. I just didn’t realize I needed to open the app when using it via the terminal, and it sounds like even this wrinkle will be smoothed out soon.

I’m a non-technical founder so if I can do it, pretty much and HNer should be able to do so!