It isn't an arbitrary wavelength. It's an entire absorption spectrum.

If the wavelength were the determining factor, green would be gender-neutral, and purple would be androgynous.

Not that this particular societal prejudice could ever be explained rationally, of course.~