Sure, differences matter, but the point is that there will be consequences. It is perfectly reasonable to assume that they should never be violent or threatening, but it is unreasonable to expect that there will not be any. That's just selfish entitlement: "the world should work this way because it pleases me so, regardless of facts".