News for hackers. Stuff that matters.
Re:LoRA Learns Less and Forgets Less by 3abiton on Friday May 17, 2024 @08:01PM (#40395346)
Any real world performance comparison between QLoRa and LoRa?
Re:LoRA Learns Less and Forgets Less by danielhanchen on Saturday May 18, 2024 @03:10AM (#40397034)
The QLoRA paper itself provided some cool benchmarks across many many experiments - QLoRA is near equivalent to LoRA, with it sometimes exceeding or losing 1-2% accuracy (it depends on the use case)