News for hackers. Stuff that matters.
Re:CodeAlpaca – Instruction following code generation model by cfn on Saturday March 25, 2023 @05:18PM (#35307489)
Llama has a 65B model and it runs (albeit slowly) on a 64gb Mac Studio with llama.cpp.
Re:CodeAlpaca – Instruction following code generation model by bestcoder69 on Saturday March 25, 2023 @07:16PM (#35308591)
Yea I have that running. Looking specifically for a 65B instruction-tuned model. I just found a way to get alpaca 30B going though.