Similarly with Judaism. There is a distinction between 'criticizing Judaism' and being 'anti-Semitic.' Let's figure this out.
In both cases we should be making these distinctions without resorting to slurs and violence.
You will find this conflation in just about any widely distributed group of people you can imagine. It extends from Islamists, to Jews, to feminists, and that's just off the top of my head. There are certainly more.
People who parrot the "criticizing X means harassing members of group X" angle shouldn't be given the time of day, and yet, they are. It's a surprisingly effective tactic for shutting down debate, since apparently being called "anti-X" has become a worse thing than actually taking concrete action against X.
It is possible to criticize fundamentalist Judaism, and the actions of Israel, without being anti-Semitic.
At the exact same time, it is possible to criticize the many illiberal components of fundamentalist Islam without being anti-Islamic.
It is only because we accept that some areas are 'off limits' for conversation that these conflations are allowed to be made.
This contrasts with Judaism. Anti-judaism speech is ok. Anti-semitic speech is not.
To me, it's more of a preference of identity. Either I identify me by faith, or I identify me by my people.
In the West - America, at least - religious bigotry seems more acceptable than racial bigotry. Bigotry against Muslims is not, then, the same thing as bigotry against, say, Arabs.
Which issues are cast as free speech issues is a highly political matter.