Yea, and my point was that this can be expensive regardless of the semantics of whether or not architectural degrees of freedom are hyperparameters.