Except when we're talking about other entities, they also have their own rights to free speech/free association. It's nice to say that free speech is a social virtue, but would you be willing to hold a Klan rally/BLM rally in your front yard?