News for hackers. Stuff that matters.

A comment on A 30B Qwen Model Walks into a Raspberry Pi and Runs in Real Time. Parent comment

Re:A 30B Qwen Model Walks into a Raspberry Pi and Runs in Re... by kouteiheika on Tuesday January 06, 2026 @11:41PM (#46522640)
> (If you have a bunch of money and patience, you can also run something like GPT OSS 120B or GLM 4.5 Air locally.)

Don't need patience for these, just money. A single RTX 6000 Pro runs those great and super fast.

[ Parent | on HN ]
Re:A 30B Qwen Model Walks into a Raspberry Pi and Runs in Re... by Muromec on Wednesday January 07, 2026 @01:50AM (#46523354)
Oh... 8 thousand of eurobucks for the thing.
[ Parent | on HN ]
Re:A 30B Qwen Model Walks into a Raspberry Pi and Runs in Re... by cfn on Wednesday January 07, 2026 @03:28AM (#46523943)
Or 4 thousand for the NVIDIA RTX A6000 which also runs the 120b just fine (quantized).
[ Parent | on HN ]
Re:A 30B Qwen Model Walks into a Raspberry Pi and Runs in Re... by sofixa on Wednesday January 07, 2026 @08:11AM (#46525999)
Or a single AMD Strix Halo with lots of RAM, which could be had before the RAM crisis for ~1.5k eur.
[ Parent | on HN ]
Re:A 30B Qwen Model Walks into a Raspberry Pi and Runs in Re... by Haaargio on Wednesday January 07, 2026 @08:38AM (#46526237)
Or why not just buy a blackwell rack?

Runs everything today with bleeding edge performance.

Overall whats the difference between 8k or 30k?

/s

[ Parent | on HN ]
Re:A 30B Qwen Model Walks into a Raspberry Pi and Runs in Re... by kouteiheika on Wednesday January 07, 2026 @11:18AM (#46528187)
You jest, but there's a ton of people on /r/localLLaMA which have an RTX 6000 Pro. No one has a Blackwell rack.

As long as you have the money this hardware is easily accessible to normal people, unlike fancy server hardware.

[ Parent | on HN ]
Re:A 30B Qwen Model Walks into a Raspberry Pi and Runs in Re... by scotty79 on Wednesday January 07, 2026 @09:13AM (#46526570)
> GPT OSS 120B

This one runs at perfectly servicable pace locally on a laptop 5090 with 64gb system ram with zero effort required. Just download ollama and select this model from the drop-down.

[ Parent | on HN ]