There’s certainly something here, but I agree the framing as if fetishization were the cause is a real stretch.

Women are the “fairer sex” as they say. Maybe that’s a cultural phenomenon as well, but seems like a better culprit in this case.