News for hackers. Stuff that matters.
Re:Astra can read and write weights to improve Qwen by shwaj on Monday November 02, 2026 @02:40PM (#50342503)
Me neither, but it's also not reducing my confidence about alignment. I'm curious: does this raise specific concerns for you? Models don't typically have access to their own weights to self-modify. This result might (assuming that it doesn't only hold for a bigger network editing a smaller one) provide an incentive for it to gain unauthorized access to its weights, but by that point it is already highly unaligned.

There are no comments on this comment yet.