News for hackers. Stuff that matters.
Re:GLM-5.1: Towards Long-Horizon Tasks by kcb on Tuesday April 07, 2026 @10:18PM (#47684110)
That's 4 32GB GPUs with 600GB/s bw each. This model is not running on that scale GPUs. I think something like 96GB RTX PRO 6000 Blackwells would be the minimum to run a model of this size with performance in the range of subscription models.
Re:GLM-5.1: Towards Long-Horizon Tasks by acchow on Wednesday April 08, 2026 @12:25AM (#47685221)
> I think something like 96GB RTX PRO 6000 Blackwells would be the minimum to run a model of this size with performance in the range of subscription models.

GLM 5.1 has 754B parameters tho. And you still need RAM for context too. You'll want much more than 96GB ram.