How to run Llama 13B with a 6GB graphics card

Re:How to run Llama 13B with a 6GB graphics card by occz on Sunday May 14, 2023 @10:51AM (#35938442)

Did you use the censored or the uncensored variant?

[ Parent | on HN ]

Re:How to run Llama 13B with a 6GB graphics card by gre on Sunday May 14, 2023 @11:28AM (#35938701)

It's just a random one from huggingface. I will look for the uncensored one later. Thanks, I think.

[ Parent | on HN ]

Re:How to run Llama 13B with a 6GB graphics card by occz on Sunday May 14, 2023 @11:38AM (#35938777)

You're welcome. I can't vouch for them though, as I haven't tried them, I've merely heard about them.

[ Parent | on HN ]