News for hackers. Stuff that matters.

A comment on How to run Llama 13B with a 6GB graphics card. Parent comment

Re:How to run Llama 13B with a 6GB graphics card by elorant on Sunday May 14, 2023 @04:29PM (#35941117)
For the tasks I need it the efficiency is similar to the online model. Only slower. I don't care for conversational functionality.
[ Parent | on HN ]

There are no comments on this comment yet.