Re:CodeAlpaca – Instruction following code generation model
by menzoic on Saturday March 25, 2023 @11:41AM
(#35303769)
Anyone with a few hundred bucks to spare can do it by renting GPUs from a cloud provider. It only cost Stanford $600 to create Alpaca from LLAMA. $100 to generate instructions with GPT-3 and $500 to rent cloud GPUs. The license restriction is due to the use of GPT-3 output to train a model.
[ Parent
| on HN ]
Re:CodeAlpaca – Instruction following code generation model
by MacsHeadroom on Saturday March 25, 2023 @01:32PM
(#35304938)
More like $50 or even $5 or less for the cloud GPUs. Alpaca-7B's compute costs were close to $50 and that was before the 100x cost savings of using LoRA.
A 4bit LoRA fine tune of this project would cost less than $5 to train even up to 30B/33B.
Re:CodeAlpaca – Instruction following code generation model
by nickthegreek on Saturday March 25, 2023 @01:33PM
(#35304941)
I’d love to see a crowdsourcing platform to donate to specific fine-tuning projects. I would gladly throw some money at someone to do the labor and release the models to the public.