News for hackers. Stuff that matters.

A comment on How to run Llama 13B with a 6GB graphics card. Parent comment

Re:How to run Llama 13B with a 6GB graphics card by MPSimmons on Monday May 15, 2023 @12:42AM (#35943953)
Oh, I figured this out. It runs with 512 as the default context, but you can increase it with -c
[ Parent | on HN ]

There are no comments on this comment yet.