News for hackers. Stuff that matters.
Re:DyLoRA: Parameter Efficient Tuning of Pre-Trained Models by whimsicalism on Monday April 10, 2023 @10:04PM (#35519820)
Right but the way that this paper proposes determining the best rank is by training a LoRA with the full rank.

There are no comments on this comment yet.