I think there will always be a discrepancy. Same with the beauty industry that failed to attract men proportionally. It grows for men, but not to a degree some articles would suggest year after year. Doesn't work anyway, look at people above 60 and the men don't look worse than women.

Nobody wants to look bad, but there are different degrees of effort people put into it.

That aside, I think retail will still suffer greatly compared to online sales since most have a service to send back clothing for free.