News for hackers. Stuff that matters.
Re:LoRA Learns Less and Forgets Less by chriskanan on Friday May 17, 2024 @01:54PM (#40392509)
This study is great and addresses a question I've had about LoRA for a while.

In a continual learning paper from last year, I found LoRA was extremely effective for faster fine-tuning and not forgetting the original dataset:

https://arxiv.org/abs/2306.01904

There are no comments on this comment yet.