Re:Astra can read and write weights to improve Qwen
by charm137 on Monday November 02, 2026 @02:32PM
(#50342360)
I don't know if some of the labs already knew of this. But I think there would be a limit to how big a model you can push into the context of the editor models. Typically, with 1M context and say 5120 hidden dimensions supported at fp16 / bf16, you could potentially edit the weights of an fp4 20B param model (roughly).
[ Parent
| on HN ]
There are no comments on this comment yet.