Re:SVDQuant: 4-Bit Quantization Powers 12B Flux on a 16GB 40...
by doctorpangloss on Saturday November 09, 2024 @04:32PM
(#42097014)
Why? There is nothing to customize with Flux.
[ Parent
| on HN ]
Re:SVDQuant: 4-Bit Quantization Powers 12B Flux on a 16GB 40...
by thot_experiment on Sunday November 10, 2024 @04:20PM
(#42102687)
What do you mean there's nothing to customize with Flux, can you expand on this claim?