Re:Ask HN: Cheapest hardware to run Llama 2 70B
by Patrick_Devine on Friday August 11, 2023 @11:18AM
(#37089671)
You can run `ollama run wizard-vicuna-uncensored:13b` and it should pull and run it. For llama2 13b, it's `ollama run llama2:13b`. I haven't seen the 13b uncensored version yet.
There's a complete list of models at https://gist.github.com/mchiang0610/b959e3c189ec1e948e4f6a1f...
We'll have a better way to browse these soon.