News for hackers. Stuff that matters.
Re:Large language models are having their Stable Diffusion m... by sebzim4500 on Sunday March 12, 2023 @01:53PM (#35123559)
From what I can tell, the quantization being used there is extremely naive.

If they were using techniques like GPTQ, presumably it would work much better.

https://arxiv.org/pdf/2210.17323.pdf

There are no comments on this comment yet.