Re:QwQ-32B: Embracing the Power of Reinforcement Learning
by seanmcdirmid on Thursday March 06, 2025 @01:28PM
(#43283416)
A max with 64 GB of ram should be able to run this (I hope). I have to wait until an MLX model is available to really evaluate its speed, though.
[ Parent
| on HN ]
Re:QwQ-32B: Embracing the Power of Reinforcement Learning
by mettamage on Thursday March 06, 2025 @02:03PM
(#43283915)
Yep, it does that. I have 64 GB and was actually running 40 GB of other stuff.
Re:QwQ-32B: Embracing the Power of Reinforcement Learning
by pickettd on Thursday March 06, 2025 @08:58PM
(#43286855)
Looks like MLX quants are released:
Re:QwQ-32B: Embracing the Power of Reinforcement Learning
by seanmcdirmid on Friday March 07, 2025 @12:36PM
(#43292182)
I downloaded the 8 bit quant last night but haven't had a chance to play with it yet.