Yes. Reading the reasoning traces in the original post, I got the impression that LLM weights are generally not interpretable even with frontier models. It's impressive that Astra can perform a small surgery on Qwen, but it's not the same thing as being capable of fully understanding its weights.

Maybe it's bit like neurosurgery. We humans can treat certain pathological cases in our brains, but we are not exactly sure how our brains really work.