Re:Run Llama 2 Uncensored Locally
by gnicholas on Wednesday August 02, 2023 @01:58PM
(#36974460)
I have downloaded and run ollama successfully on my Mac in the past, but when I try to run one of these commands, it doesn't work (connection refused). What am I doing wrong?
[ Parent
| on HN ]
This is usually because the Ollama server isn't running. To solve it either:
- Start the Ollama app (which will run the Ollama server)
- Open terminal: `ollama serve` to start the server.
We'll fix this in the upcoming release
Ah, perfect, thanks!
Is there some kind of tutorial for installing these (and their dependencies) somewhere?
One that assumes i can set up python modules and compile stuff but i have no idea about all these LLM libraries would be enough thank you.
Re:Run Llama 2 Uncensored Locally
by fprotthetarball on Wednesday August 02, 2023 @07:22PM
(#36979274)
Ollama is the best I have seen if you want to play around with LLMs.
After installing the application and running it, you run "ollama run <model name>" and it handles everything and drops you into a chat with the LLM. There are no dependencies for you to manage -- just one application.
Check out the README: https://github.com/jmorganca/ollama#readme
Ollama is pretty dead simple, with no dependencies to manage. I just didn’t realize I needed to open the app when using it via the terminal, and it sounds like even this wrinkle will be smoothed out soon.
I’m a non-technical founder so if I can do it, pretty much and HNer should be able to do so!