Re:Qwen3 30B A3B Hits 13 token/s on 4xRaspberry Pi 5
by trebligdivad on Saturday September 06, 2025 @07:39PM
(#45153902)
Spunds close! top says my llama is using 17.7G virt, 16.6G resident with:
./build/bin/llama-cli -m /discs/fast/ai/Qwen3-Coder-30B-A3B-Instruct-IQ4_NL.gguf --jinja -ngl 99 --temp 0.7 --min-p 0.0 --top-p 0.80 --top-k 20 --presence-penalty 1.0 -t 32 -dev none
[ Parent
| on HN ]
There are no comments on this comment yet.