Re:LoRA Learns Less and Forgets Less
by danielhanchen on Saturday May 18, 2024 @03:10AM
(#40397034)
The QLoRA paper itself provided some cool benchmarks across many many experiments - QLoRA is near equivalent to LoRA, with it sometimes exceeding or losing 1-2% accuracy (it depends on the use case)
[ Parent
| on HN ]
There are no comments on this comment yet.