News for hackers. Stuff that matters.

A comment on Astra can read and write weights to improve Qwen. Parent comment

Re:Astra can read and write weights to improve Qwen by buildbot on Monday November 02, 2026 @05:36PM (#50345012)
It has! Hypernetwok/weight generation has been a thing for a long time - in fact my Master's thesis back in 2018 was based around PRNG weight generation for large percentages of the network. (https://open.library.ubc.ca/media/stream/pdf/24/1.0371928/3)

Why is this not overhyped in my opinion? Nothing has worked this well, ever.

[ Parent | on HN ]
Re:Astra can read and write weights to improve Qwen by _bobm on Tuesday November 03, 2026 @12:40AM (#50348506)
Right. The question to ask is whether it is an emergent property of the model, Astra, or it was trained for it.

Whichever, it betrays a rather interesting feature about the model's architecture and this won't go unnoticed, I think, by the chinese labs.

[ Parent | on HN ]