News for hackers. Stuff that matters.
Re:SVDQuant: 4-Bit Quantization Powers 12B Flux on a 16GB 40... by superkuh on Saturday November 09, 2024 @10:10AM (#42094807)
Except in this case they quantized both the parameters and the activations leading to decreased compute time too.

There are no comments on this comment yet.