Yeah, it's also misogynist, but it's not the bad sort of racially coded misogyist slur, so it's low-status to complain about it or even acknowledge it. Hence the comments pretending not to know what you mean or implying your racial politics are suspect.