Perhaps fewer votes is exactly what you want. I can imagine that lots of people read things and go "Oh - yeah - (click)" without thinking too hard. Perhaps requiring mental investment on the part of the voter is a good thing.