Astra can read and write weights to improve Qwen

Re:Astra can read and write weights to improve Qwen by neuronexmachina on Monday November 02, 2026 @02:58PM (#50342768)

I appreciate the post included the reasoning traces they had available, but it's too bad the first part of it is internal/hidden to Astra. The first bit of that process is what I'm most curious about:

> [Before writing this, Astra thought for 1,034 tokens. That thinking is hidden. The API returns only its 5 headings: Reconstructing the active map / Mapping maze corridors / Preparing exact maze map / Reconstructing row groupings / Checking channel patterns]

[ Parent | on HN ]

Re:Astra can read and write weights to improve Qwen by bscphil on Monday November 02, 2026 @03:36PM (#50343345)

I agree. I think for this kind of research it would be much better to at least attempt it first with a weaker model where the whole process is transparent. I was working on a project a while back, and Deepseek's reasoning said something to the effect of "I remember (from leaked copies of the source code)..." Of course that could be hallucinated, but it would be good to know whether Astra is bringing to bear knowledge on how to post-train exactly this model.

[ Parent | on HN ]

Re:Astra can read and write weights to improve Qwen by lostmsu on Monday November 02, 2026 @03:56PM (#50343617)

This sounds more like "A working Nintendo in ~1GB of Qwen weights" from 3 days ago, human-made, than what everyone expects.

https://news.ycombinator.com/item?id=50306442

[ Parent | on HN ]