A 30B Qwen Model Walks into a Raspberry Pi and Runs in Real Time

Re:A 30B Qwen Model Walks into a Raspberry Pi and Runs in Re... by Muromec on Wednesday January 07, 2026 @01:50AM (#46523354)

Oh... 8 thousand of eurobucks for the thing.

[ Parent | on HN ]

Re:A 30B Qwen Model Walks into a Raspberry Pi and Runs in Re... by cfn on Wednesday January 07, 2026 @03:28AM (#46523943)

Or 4 thousand for the NVIDIA RTX A6000 which also runs the 120b just fine (quantized).

[ Parent | on HN ]