I mean… they might try to, but that line of reasoning doesn’t hold up to even cursory examination.

The position itself—about othering certain groups—would hold up by itself of course. Unfortunately for those you mention it’s most often employed by those on their side of the debate about groups they dislike (Muslims, gay, trans, etc).