News for hackers. Stuff that matters.
Re:QwQ-32B: Embracing the Power of Reinforcement Learning by seanmcdirmid on Thursday March 06, 2025 @01:28PM (#43283416)
A max with 64 GB of ram should be able to run this (I hope). I have to wait until an MLX model is available to really evaluate its speed, though.
Re:QwQ-32B: Embracing the Power of Reinforcement Learning by mettamage on Thursday March 06, 2025 @02:03PM (#43283915)
Yep, it does that. I have 64 GB and was actually running 40 GB of other stuff.
Re:QwQ-32B: Embracing the Power of Reinforcement Learning by pickettd on Thursday March 06, 2025 @08:58PM (#43286855)
Re:QwQ-32B: Embracing the Power of Reinforcement Learning by seanmcdirmid on Friday March 07, 2025 @12:36PM (#43292182)
I downloaded the 8 bit quant last night but haven't had a chance to play with it yet.