News for hackers. Stuff that matters.
Re:SVDQuant: 4-Bit Quantization Powers 12B Flux on a 16GB 40... by doctorpangloss on Saturday November 09, 2024 @04:32PM (#42097014)
Why? There is nothing to customize with Flux.
Re:SVDQuant: 4-Bit Quantization Powers 12B Flux on a 16GB 40... by thot_experiment on Sunday November 10, 2024 @04:20PM (#42102687)
What do you mean there's nothing to customize with Flux, can you expand on this claim?