The problem is that the bot has only a single voice against a whole community.

Twitter trusts the numbers, in a sense, it is very democratic. Trolls are simply very good at strategic voting.