Re:Astra can read and write weights to improve Qwen
by pama on Monday November 02, 2026 @09:47PM
(#50347384)
To be clear, the tuned model here performs worse than the same qwen model performed before RL, which was also not going in circles. It also performs much worse than the RL model that goes in circles. One could argue that the reduction of context may be worth something, but it appears that the final model is worse in all respects than the model at a much earlier stage of training.
[ Parent
| on HN ]
Re:Astra can read and write weights to improve Qwen
by tesnorindian on Tuesday November 03, 2026 @02:21AM
(#50349057)
You can ask Astra to study 2 or more models and ask it to import their layers to the Qwen model. With this will it not gain more than what it learned with RL?