News for hackers. Stuff that matters.

A comment on Astra can read and write weights to improve Qwen. Parent comment

Re:Astra can read and write weights to improve Qwen by giancarlostoro on Monday November 02, 2026 @03:50PM (#50343516)
> but if it'd cheaper the authors don't go into

Merging a model and a LoRa is insanely cheap, so assuming it didn't use any GPUs to do inspection etc, and just looked at a file on a FS, then I would be willing to say... It's cheaper than training a LoRa if that's the case, assuming Astra didn't take several weeks?

[ Parent | on HN ]
Re:Astra can read and write weights to improve Qwen by BoorishBears on Monday November 02, 2026 @09:26PM (#50347208)
The examples are presented like the findings build on each other, but they don't: Astra couldn't do anything with just numerical weights once they moved to Qwen.
[ Parent | on HN ]