There are probably situations where it's an innocuous remark, but surely you can see that depending on the tone and what is implied, it might be extremely offensive, not very different from saying something like "oh, you're a woman, that's certainly surprising because women are awful at math and coding!"