News for hackers. Stuff that matters.

A comment on How to run Llama 13B with a 6GB graphics card. Parent comment

Re:How to run Llama 13B with a 6GB graphics card by sagarm on Sunday May 14, 2023 @01:31PM (#35939634)
I think it's mostly useful if you want to do your own fine tuning, or the data you are working with can't be sent to a third party for contractual, legal, or paranoid reasons.
[ Parent | on HN ]
Re:How to run Llama 13B with a 6GB graphics card by sroussey on Sunday May 14, 2023 @05:32PM (#35941513)
I’m working on an app to index your life, and having it local is a huge plus for the people I have using it.
[ Parent | on HN ]
Re:How to run Llama 13B with a 6GB graphics card by theaussiestew on Sunday May 14, 2023 @10:54PM (#35943435)
Sounds interesting, got a link?
[ Parent | on HN ]
Re:How to run Llama 13B with a 6GB graphics card by sroussey on Tuesday May 16, 2023 @12:40AM (#35957812)
Not yet…
[ Parent | on HN ]