One might apply this argument to HN, where mods can silently ban people so that those who are banned don't realize. I mean, are you going to create your own HN? It doesn't matter if creating HN is easier than creating an ISP if the task is practically unsurmountable.

Isn't the issue here freedom of association? When in conflict with freedom of speech, which is more important, and why?