News for hackers. Stuff that matters.
Re:Inkling 2 Mini by ycui7 on Friday November 20, 2026 @07:49PM (#50584545)
why do people need to even quantize this model? it is already in nvfp4.
Re:Inkling 2 Mini by daemonologist on Friday November 20, 2026 @08:14PM (#50584758)
If your GPU has less than 24 GB of VRAM you might want it smaller. On non-Blackwell it probably doesn't make much speed difference. Also, requantizing to a more standard format might be needed for some engine/hardware combinations(?)