This is certainly true of shoes with those plastic inserts around the back. I mostly wear casual shoes, specifically the Adidas gazelles which do not have anything rigid on the back and have a low friction leather outside which makes slipping them on easy.
Normally a good way to ruin the back of the collar though, especially if they have achilles support structures (like some running shoes.)
Source: many of my shoes with ruined collars.