If the first few people to see something downvotes you into oblivion before the majority arriving later get a chance to see your content, that's silencing, not merely not being listened to. This is doubly true when those first few people are likely to be regulars that refresh pages often. This means that a few people that are ideologically on the same page can drive the ideological view of an entire forum without actually being a moderator.