I think edits made directly to model weights are likely to be more interpretable and controllable than edits made by the current process of shoving a bunch of training data through gradient descent.