Re:LoRA Learns Less and Forgets Less
by 3abiton on Friday May 17, 2024 @08:01PM
(#40395346)
Any real world performance comparison between QLoRa and LoRa?
[ Parent
| on HN ]
Re:LoRA Learns Less and Forgets Less
by danielhanchen on Saturday May 18, 2024 @03:10AM
(#40397034)
The QLoRA paper itself provided some cool benchmarks across many many experiments - QLoRA is near equivalent to LoRA, with it sometimes exceeding or losing 1-2% accuracy (it depends on the use case)