News for hackers. Stuff that matters.
Re:LoRA Learns Less and Forgets Less by danielhanchen on Saturday May 18, 2024 @03:10AM (#40397034)
The QLoRA paper itself provided some cool benchmarks across many many experiments - QLoRA is near equivalent to LoRA, with it sometimes exceeding or losing 1-2% accuracy (it depends on the use case)

There are no comments on this comment yet.