News for hackers. Stuff that matters.
Re:Implementing Weight-Decomposed Low-Rank Adaptation (DoRA)... by rasbt on Sunday February 18, 2024 @04:33PM (#39423608)
Thanks for the feedback. Clarifying definitely wouldn't hurt. Added a paragraph and new figure at the top of the DoRA section: https://magazine.sebastianraschka.com/i/141797214/introducin...

I haven't tried what you were suggesting, but that sounds actually plausible. Interesting idea!

There are no comments on this comment yet.