Re:Qwen3 30B A3B Hits 13 token/s on 4xRaspberry Pi 5
by nullsmack on Sunday September 07, 2025 @10:58AM
(#45158751)
The mini pcs based on AMD Ryzen AI Max+ 395 (Strix Halo) are probably pretty competitive with those. Depending on which one you buy it's $1700-2000 for one with 128GB RAM that is shared with the integrated Radeon 8060S graphics. There's videos on youtube talking about using this with the bigger LLM models.
[ Parent
| on HN ]
There are no comments on this comment yet.