Re:Astra can read and write weights to improve Qwen
by jrflo on Monday November 02, 2026 @03:05PM
(#50342881)
This seems emergent to me. LLMs are not trained directly on how to read weights, because humans do not understand raw weights, so there is no training data. They're trained on how to use the tools we have like writing python, examining training output and iterating, not writing whole weights from scratch.
[ Parent
| on HN ]
Re:Astra can read and write weights to improve Qwen
by paxy on Monday November 02, 2026 @03:28PM
(#50343230)
Humans don’t need to understand the data for models to train on it.
A large enough number of examples of “here are the model weights -> here’s what it does” will achieve this.
Re:Astra can read and write weights to improve Qwen
by throwaway219450 on Monday November 02, 2026 @03:14PM
(#50343015)
In a self-supervised setting you don't need ground truth data, as long as you have a proxy task that you can train on which forces the model to learn something useful. Like cutting out bits of images and telling the model to reconstruct the gaps (i.e. MAEs).
There are also techniques to watermark model weights to confirm what training data were used: https://arxiv.org/html/2512.17075 I'm not an expert in this domain, but it seems like there are lots of pieces that could be used to (a) train a model to infer whether some data were trained on and (b) train a model to understand which weights are relevant for a particular training task in a more explainable way than backprop/gradient descent.
Re:Astra can read and write weights to improve Qwen
by yorwba on Monday November 02, 2026 @03:16PM
(#50343052)
In cases where Astra succeeded, it succeeded using standard techniques also used by humans when they read and write neural network weights. It's a rare skill, mostly used for fun (e.g. https://blog.janestreet.com/can-you-reverse-engineer-our-neu... ) and basic research rather than profit, but Astra is big enough to have learned many rare skills.