News for hackers. Stuff that matters.
Re:QwQ-32B: Embracing the Power of Reinforcement Learning by whitehexagon on Thursday March 06, 2025 @11:32AM (#43282063)
Does the Q8 fit within your 32GB (also using an M1 32GB)
Re:QwQ-32B: Embracing the Power of Reinforcement Learning by manmal on Thursday March 06, 2025 @12:30PM (#43282811)
No, Q4 just barely fits, and with a longer context sometimes things freeze. I definitely have to close Xcode.