Re:LoRA Learns Less and Forgets Less
by buildbot on Friday May 17, 2024 @03:18PM
(#40393316)
Yeah, exactly. Though the 48k param lora might be as good as a 48k param layer of higher rank, I haven't looked into that case really.
[ Parent
| on HN ]
There are no comments on this comment yet.