News for hackers. Stuff that matters.

A comment on SVDQuant: 4-Bit Quantization Powers 12B Flux on a 16GB 4090 GPU with 3x Speedup.

Re:SVDQuant: 4-Bit Quantization Powers 12B Flux on a 16GB 40... by scottmas on Saturday November 09, 2024 @08:36AM (#42094330)
Possible to run this in ComfyUI?
[ Parent | on HN ]
Re:SVDQuant: 4-Bit Quantization Powers 12B Flux on a 16GB 40... by vergessenmir on Saturday November 09, 2024 @09:34AM (#42094629)
The repo has sample code and it is fairly easy to create a node that will do it.

You won't however have access to usual sampler, latent image, Lora nodes to do anything beyond basic t2i

[ Parent | on HN ]
Re:SVDQuant: 4-Bit Quantization Powers 12B Flux on a 16GB 40... by doctorpangloss on Saturday November 09, 2024 @04:32PM (#42097014)
Why? There is nothing to customize with Flux.
[ Parent | on HN ]
Re:SVDQuant: 4-Bit Quantization Powers 12B Flux on a 16GB 40... by thot_experiment on Sunday November 10, 2024 @04:20PM (#42102687)
What do you mean there's nothing to customize with Flux, can you expand on this claim?
[ Parent | on HN ]