Right, but the existence of edge cases does not mean that the "male" and "female" labels are completely arbitrary.

The words "bed" and "sofa" aren't arbitrary social constructs just because sofabeds exist.