CodeAlpaca – Instruction following code generation model

Re:CodeAlpaca – Instruction following code generation model by bestcoder69 on Saturday March 25, 2023 @02:30PM (#35305551)

Anyone know of a 65B instruct model I can run on llama.cpp? Or if it’s possible to train one on a 64gb Mac Studio? Haven’t come across either yet.

[ Parent | on HN ]

Re:CodeAlpaca – Instruction following code generation model by sahil_chaudhary on Saturday March 25, 2023 @02:48PM (#35305759)

I'm training a 65B model right now, also I believe you can use lora-alpaca to train on this data on a much smaller machine.

[ Parent | on HN ]

Re:CodeAlpaca – Instruction following code generation model by cfn on Saturday March 25, 2023 @05:18PM (#35307489)

Llama has a 65B model and it runs (albeit slowly) on a 64gb Mac Studio with llama.cpp.

[ Parent | on HN ]

Re:CodeAlpaca – Instruction following code generation model by bestcoder69 on Saturday March 25, 2023 @07:16PM (#35308591)

Yea I have that running. Looking specifically for a 65B instruction-tuned model. I just found a way to get alpaca 30B going though.

[ Parent | on HN ]