Astra can read and write weights to improve Qwen

Re:Astra can read and write weights to improve Qwen by rocqua on Tuesday November 03, 2026 @04:31AM (#50349855)

Not who you asked, but biological brains come about very differently than LLM neural networks. Most notably, they come about largely through plasticity, and with evolutionary pressure towards exhibiting plasticity.

My guess would be that the structure to allow for plasticity to work is a strong limit to how well you can tune weights to fit training data. My (doubtless massively oversimplified and way behind the state-of-the art) understanding of neuro-plasticity is something like "often used pathways get stronger connections". Which, even with significant tweaks, is quite different from the gradient descent used to tune neural networks.

[ Parent | on HN ]

Re:Astra can read and write weights to improve Qwen by TonyStr on Tuesday November 03, 2026 @06:21AM (#50350606)

If strengthening of frequently used neural pathways is all our brains do, I don't see how it's seemingly capable of reordering knowledge physically from one part of the brain to another (which I believe is the case). Infrequently used pathways would simply rot away and die away over time, rather than being moved somewhere else for long-term storage to keep the high-frequency pathways more available.

[ Parent | on HN ]