I think a pretty tactful way to put it is "male | female | NULL", and I'm only half joking.

Many people prefer not to say for whatever reason, and people identifying as anything other than male or female aren't going to be a statistically significant minority for whatever data collection purpose you have.