A simple guide to fine-tuning Llama 2

Re:A simple guide to fine-tuning Llama 2 by samlhuillier on Monday July 24, 2023 @03:56PM (#36853393)

Working on this now!

[ Parent | on HN ]

Re:A simple guide to fine-tuning Llama 2 by syntaxing on Monday July 24, 2023 @04:06PM (#36853488)

I’m looking forward to this! Are you using an adapter (I don’t see it mentioned in your article)? I was under the impression you cannot fit 7B at 4 bit since it’ll take 25GB of VRAM or so.

[ Parent | on HN ]

Re:A simple guide to fine-tuning Llama 2 by samlhuillier on Monday July 24, 2023 @05:18PM (#36854328)

Yes using the qlora adapter that hugging face provides with peft

[ Parent | on HN ]

Re:A simple guide to fine-tuning Llama 2 by syntaxing on Monday July 24, 2023 @09:38PM (#36856763)

ahh, I was on my phone before so I must of glimpsed over it, I see it on the last section. Thanks!

[ Parent | on HN ]