Unfortunately true even in the case of Watch updates. That’s why the trick to make it faster is to kill Bluetooth via Settings.app after it starts downloading an update. Easily half the time spent waiting!