I don't agree that it's specific to women. How many times did you hear about reversible belts being "cheap"? How many people have strong opinions about the width of the tie, even though the target changes every decade? What about shoes / trousers / belt colour matching? Why are socks and sandals a bad match? Why is a vest a wife-beater? There's nothing intrinsically better/worse about those situations - they're weird norms created between the industry, society and Beau Brummell.

Men's fashion or even just basic clothing choices are very restricted as well and have their own rules. In that case it's not fast fashion, but the toxic fashion industry goes well beyond feminity.