News for hackers. Stuff that matters.
Re:LoftQ: LoRA-fine-tuning-aware Quantization by moochee on Wednesday December 20, 2023 @12:32AM (#38705777)
Thanks. LoftQ = Quantization + LoRA fine-tuning. What's the difference between LoftQ vs QLoRA then?
Re:LoftQ: LoRA-fine-tuning-aware Quantization by tourzhao on Wednesday December 20, 2023 @04:32PM (#38713929)
LoftQ = Quantization optimized for LoRA + Better LoRA Adaptor initialization + LoRA fine-tuning.