Re:Astra can read and write weights to improve Qwen
by shwaj on Monday November 02, 2026 @02:40PM
(#50342503)
Me neither, but it's also not reducing my confidence about alignment. I'm curious: does this raise specific concerns for you? Models don't typically have access to their own weights to self-modify. This result might (assuming that it doesn't only hold for a bigger network editing a smaller one) provide an incentive for it to gain unauthorized access to its weights, but by that point it is already highly unaligned.
[ Parent
| on HN ]
There are no comments on this comment yet.