News for hackers. Stuff that matters.
Re:Qwen3 30B A3B Hits 13 token/s on 4xRaspberry Pi 5 by nullsmack on Sunday September 07, 2025 @10:58AM (#45158751)
The mini pcs based on AMD Ryzen AI Max+ 395 (Strix Halo) are probably pretty competitive with those. Depending on which one you buy it's $1700-2000 for one with 128GB RAM that is shared with the integrated Radeon 8060S graphics. There's videos on youtube talking about using this with the bigger LLM models.

There are no comments on this comment yet.