News for hackers. Stuff that matters.
Re:Astra can read and write weights to improve Qwen by worried_individ on Tuesday November 03, 2026 @06:31AM (#50350682)
like what? the post you're replying to points out that we've been able to do this for years
Re:Astra can read and write weights to improve Qwen by schleck8 on Tuesday November 03, 2026 @07:12AM (#50351025)
ROME cannot look at thousands of ASCII numbers and deduce that it’s looking at a Breakout paddle or a diffusion circle. No tool I know of can do that. And if there is one that can do it, it's new, in which case we haven't been able to do it for years.

ROME edits factual associations. It cannot write a million+ parameter Go-playing neural network from scratch that beats a network trained for 20 million games.

In weight space programming, the model can theoretically read its own weights like a compiled binary, spot an inefficiency (like the MLP direction causing reasoning loops in Exp 8), directly overwrite those floating-point values in memory, and immediately continue inference as a new iteration of itsself. That is RSI. That's why this is a big deal, it's like comparing an axe to modern surgical tools. You can amputate a limb with both, but one is going to cause lots of collateral at minimum while the other is surgically precise