Astra can read and write weights to improve Qwen

Re:Astra can read and write weights to improve Qwen by ricardobeat on Tuesday November 03, 2026 @05:20AM (#50350145)

> well past what we’d expect from humans or conventional algorithms

The model being able to simply type out NN weights, on demand, and have it outperform one trained on 100M inputs pretty much fits that description, doesn’t it?

And being able to prove that knowledge is localized using tools, is also quite different from an LLM simply looking at raw weights and instantly pointing out that 18373 controls left movement.

It’s not a fundamental change in what we know, but a new emergent ability that surely warrants some excitement.

[ Parent | on HN ]

Re:Astra can read and write weights to improve Qwen by yorwba on Tuesday November 03, 2026 @08:49AM (#50351946)

"action 3 left" is documented in the input, so you can find the corresponding weights in column 3 of the output weight matrix. If that's past what you expect from humans or conventional algorithms, your expectations are too low.

[ Parent | on HN ]