News for hackers. Stuff that matters.
Re:LoRA Learns Less and Forgets Less by buildbot on Friday May 17, 2024 @03:18PM (#40393316)
Yeah, exactly. Though the 48k param lora might be as good as a 48k param layer of higher rank, I haven't looked into that case really.

There are no comments on this comment yet.