Re:Astra can read and write weights to improve Qwen
by almostuseful on Tuesday November 03, 2026 @07:21AM
(#50351114)
If Astra uses some sort of looped transformer architecture (and if Fable doesn't), then that could explain why Astra can do more computation per token. It is essentially simulating a much deeper model.
But yea, I was also quite surprised by the low token usage.
But yea, I was also quite surprised by the low token usage.