News for hackers. Stuff that matters.
Re:Astra can read and write weights to improve Qwen by charm137 on Monday November 02, 2026 @02:32PM (#50342360)
I don't know if some of the labs already knew of this. But I think there would be a limit to how big a model you can push into the context of the editor models. Typically, with 1M context and say 5120 hidden dimensions supported at fp16 / bf16, you could potentially edit the weights of an fp4 20B param model (roughly).

There are no comments on this comment yet.