Re:Astra can read and write weights to improve Qwen
by kristopolous on Monday November 02, 2026 @09:14PM
(#50347129)
what do you mean? this is just classic computing. It's evals and linear optimization ...
Re:Astra can read and write weights to improve Qwen
by hgoel on Monday November 02, 2026 @09:42PM
(#50347334)
Given your reply, I was looking to read the paper. Apparently this blog post is what passes as their paper for now... I think I'll change my previous judgement and wait for a proper publication. I'm still not convinced by their claims, but maybe an eventual paper will spell it out more formally and convincingly instead of expecting readers to dig through all of their source code.
This means we might not need to fine-tune with thousands of passes and tons of GPU. We could just tell a frontier model to edit some weights and iterate until there's better results. This could cut the cost of fine-tunes by 100x. Makes no difference to the normal end-user, but pretty huge improvement for LLM research and model tuning.