Re:Inkling 2 Mini
by ycui7 on Friday November 20, 2026 @07:49PM
(#50584545)
why do people need to even quantize this model? it is already in nvfp4.
[ Parent
| on HN ]
Re:Inkling 2 Mini
by daemonologist on Friday November 20, 2026 @08:14PM
(#50584758)
If your GPU has less than 24 GB of VRAM you might want it smaller. On non-Blackwell it probably doesn't make much speed difference. Also, requantizing to a more standard format might be needed for some engine/hardware combinations(?)