News for hackers. Stuff that matters.
Re:Qwen3 30B A3B Hits 13 token/s on 4xRaspberry Pi 5 by trebligdivad on Saturday September 06, 2025 @07:39PM (#45153902)
Spunds close! top says my llama is using 17.7G virt, 16.6G resident with: ./build/bin/llama-cli -m /discs/fast/ai/Qwen3-Coder-30B-A3B-Instruct-IQ4_NL.gguf --jinja -ngl 99 --temp 0.7 --min-p 0.0 --top-p 0.80 --top-k 20 --presence-penalty 1.0 -t 32 -dev none

There are no comments on this comment yet.