I think it's more like, if you assume that someone is Italian and then find out that they're Mexican, it's awkward that you made an incorrect assumption about their ethnicity despite the assumption being neutral in terms of judgment.