The statement does not imply those assumptions, and even if it did, it would not be misogyny. The fact there is so much discussion about this is the 'issue' here and it's toxic.