Correct, not all models have equivalent weights at each step. But it is an abstraction that needs to be done to send it to infinity.