> Certain people or organizations, due to their size (organizations) or influence (people/organizations) become some sort of judges in moral topics and the problem here is that they usually have backgrounds in other stuff, have not been elected by anyone (often times they just start screaming louder, and people follow) and do not apply any form of fairness to the accused.

Indeed. And how far does this go? What if banks, or grocery stores, start denying someone services because they were the subject of social opprobrium? A conference is not quite the same thing, but it is still a means by which some people are able to derive their livelihoods.