You misread my point. I did not say we could not decide to censor such people, only that it is useful to have people willing to offer up a basic defense that pushes us to justify the actions we take. "Think of the children" is a way to instantly shut down opposition and win a moral argument without having to justify that your policy is well considered.