News for hackers. Stuff that matters.
Re:Implementing Weight-Decomposed Low-Rank Adaptation (DoRA)... by jasonjmcghee on Sunday February 18, 2024 @02:14PM (#39422099)
This is a bit of a misleading title. Why not use the original?

"Improving LoRA: Implementing Weight-Decomposed Low-Rank Adaptation (DoRA) from Scratch"

(If it's too long, just drop the "Improving LoRA: " part)

Re:Implementing Weight-Decomposed Low-Rank Adaptation (DoRA)... by rasbt on Sunday February 18, 2024 @02:16PM (#39422119)
Thanks, fixed!