The argument I made was originally formulated by Andrea Dworkin, testifying to Congress about pornography, and formulating it that way--what metric are you measuring freedom by--has done a lot to expand my thinking.

Another is the saying "tolerance isn't a virtue, it's a peace treaty", which I think really cuts through the apparent dilemma you highlight.