News for hackers. Stuff that matters.
Re:CodeAlpaca – Instruction following code generation model by alex_sf on Saturday March 25, 2023 @03:49PM (#35306482)
For the 65B fine tune, did you add another A100 node? Or just drop batch size?

Any chance you’re up to sharing the training parameters?

Re:CodeAlpaca – Instruction following code generation model by sahil_chaudhary on Saturday March 25, 2023 @03:51PM (#35306508)
Dropping the batch size