News for hackers. Stuff that matters.

A comment on Qwen3-235B-A22B-Thinking-2507. Parent comment

Re:Qwen3-235B-A22B-Thinking-2507 by regularfry on Friday July 25, 2025 @11:53AM (#44684600)
Hardware and cost is assumed to be approximately desktop-class. If you've got a gaming rig with an RTX 4090 and 128MB RAM, you can run this if you pick the right quant.
[ Parent | on HN ]
Re:Qwen3-235B-A22B-Thinking-2507 by cmpxchg8b on Friday July 25, 2025 @11:58AM (#44684670)
128MB? Quantization has come a long way!
[ Parent | on HN ]
Re:Qwen3-235B-A22B-Thinking-2507 by danielhanchen on Friday July 25, 2025 @04:20PM (#44687959)
I think they mis-spoke 128GB* :)
[ Parent | on HN ]
Re:Qwen3-235B-A22B-Thinking-2507 by regularfry on Friday July 25, 2025 @05:05PM (#44688460)
Wishful thinking there on my part.
[ Parent | on HN ]
Re:Qwen3-235B-A22B-Thinking-2507 by danielhanchen on Friday July 25, 2025 @05:38PM (#44688794)
Though technically < 1GB is enough - one had offload it to the SSD, albeit with very slow speeds!
[ Parent | on HN ]