News for hackers. Stuff that matters.
Re:Astra can read and write weights to improve Qwen by layer8 on Monday November 02, 2026 @03:10PM (#50342957)
I’m more shocked by how many commenters in this thread seem to be misunderstanding what is going on here.
Re:Astra can read and write weights to improve Qwen by reasonableklout on Monday November 02, 2026 @04:29PM (#50344056)
What are people misunderstanding?
Re:Astra can read and write weights to improve Qwen by layer8 on Monday November 02, 2026 @06:04PM (#50345365)
That Astra is just using the same methods as humans do (like abliteration) for modifying the behavior of a model, and that there is no particular connection to Astra itself being a model.
Re:Astra can read and write weights to improve Qwen by reasonableklout on Tuesday November 03, 2026 @01:29AM (#50348754)
That's fair, but almost everything so far that models can do much faster and deeper than humans can have been by using the same methods that humans do. For example, with cybersecurity, human researchers could if given enough time find every exploit that allowed the OAI models to escape the sandbox via Artifactory RCE and breach Hugging Face. But still there is a step change in what's possible by doing this at an industrial scale and stringing together all the solutions. The implications of applying existing mech interp capabilities this way could be very significant.