There's a sort of paradox of democracy which analogous to the paradox of tolerance. The problem is that you can elect people who destroy democratic institutions. i.e. you can democratically destroy democracy. If you tolerate those who would destroy democratic institutions, eventually those who would destroy democracy will get voted in and democracy will be destroyed - you therefore do have to limit democratic freedoms slightly to exclude those people if you wish to preserve democracy itself.