I think that depends on one's specific definition of different worlds. I thought it was a reasonable expression since men and women have very different experiences which are pervasive in the culture.

For example, "going dutch" is getting more popular, but generally men are still expected to buy drinks or pay for dinner. Women have to be more careful about date rape than men. And so on.