Of course you can, But that doesn't change the fact only one of those opinions is defensible.

If someone were to say they don't feel comfortable around Scottish people because they commit more crime. I'm sure you would (rightly) have an issue with that and agree that it is indefensible.