Re:Qwen3 30B A3B Hits 13 token/s on 4xRaspberry Pi 5
by benreesman on Saturday September 06, 2025 @10:07PM
(#45154733)
If Moore's Law is Ending leaks are to be believed, there are going to be 24GB GDDR7 5080 Super and maybe even 5070 Super Ti variants in the 1k (MSRP) range and one assumes fast Blackwell NVFP4 Tensor Cores.
Depends on what you're doing, but at FP4 that goes pretty far.
Depends on what you're doing, but at FP4 that goes pretty far.