It's interesting that they identify striding as the culprit. Striding is also, according to some people at Google AI, the reason why VGG is one of the few good CNNs for doing style transfer (which is otherwise quite mysterious: https://www.reddit.com/r/MachineLearning/comments/7rrrk3/d_e...).