Astra can read and write weights to improve Qwen

Re:Astra can read and write weights to improve Qwen by evox_group on Tuesday November 03, 2026 @06:04AM (#50350459)

This experiment is quite interesting, especially since only about 0.016% of the model weights were modified, achieving such a significant performance improvement.

However, I'm rather curious: Does this improvement come from the enhancement of the model's reasoning ability itself, or is it mainly due to the fixed issue of the model repeatedly reasoning and being unable to conclude normally?

[ Parent | on HN ]

Re:Astra can read and write weights to improve Qwen by namanbnsl on Tuesday November 03, 2026 @06:50AM (#50350837)

Mainly due to the looping.

Before the edit, 93% of MATH-500 answers hit the 32k token limit, compared to 33% after.

With 10 and 25 forward passes, looping barely decreased (87% and 86% still hit the limit) and the score didn't change much. The score jump only happened at 50 forward passes when looping decreased.

Astra edited the weights to bring out a capability the model already had rather than enhancing the ability itself. Pretty impressive.

[ Parent | on HN ]