News for hackers. Stuff that matters.
Re:QLoRA: Efficient Finetuning of Quantized LLMs by sanxiyn on Wednesday May 24, 2023 @09:44PM (#36066201)
This work introduces a new quantization scheme, NF4, for 4-bit NormalFloat, based on previous work on quantile quantization, so it's not a simple truncation, but it's also not a GPTQ-like optimization method. Figure 3 of the paper shows accuracy improvement of NF4 over FP4.
Re:QLoRA: Efficient Finetuning of Quantized LLMs by sp332 on Wednesday May 24, 2023 @10:37PM (#36066494)