(I don’t know anything about this field, but) I’m guessing the reason we keep language instead of going straight to latent space is that you wouldn’t want to remove the only (?) remaining concept which still somewhat allows us to peek into the “thought process” in a way we can (hope to) understand wrt. models’ interpretability…