I haven't had much trouble with that personally. Sometimes the first wash will shrink clothes slightly but afaik a lot of clothing manufacturers these days put clothes through a 'pre-shrinking' process that compacts them down simulating the shrinking process so they won't shrink appreciably.

A bigger concern is additional wear and tear. Dryers seem to be harsh on clothing and will reduce the lifespan vs just hanging.