Your doctor does need to know your gender as well as your sex, especially your GP. It's part of your behavior and mental health, which is also their remit.