I don't think there's a problem with you being critical of any specific action without being labelled an anti-semite. Some things are just plain wrong. Some things are more nuanced so it's nice to acknowledge this nuance, e.g. "I disagree that X is a good reason for Y" rather than saying "I condemn Y". Sweeping generalizations are probably less useful.

That said, if one's focus is 100% on "things that Jews do wrong" .. maybe that's something else.

Also indigenous populations in the Americas are still being wronged today!