Depending on the topic of conversation, this would often be considered incredibly sexist or racist. (Which has never made sense to me, but that seems to be the case with a lot of people.)