This sounds like you are deliberately building an echo chamber. Sure, I understand you don't want random voting to be rewarded, but this will actively punish people who simply prefer a different aesthetic than the majority.

Voting mechanism is currently very harsh. Thank you for your feedback, we will consider it in the next updates. Initially, we wanted Comparere to operate on the basis of A/B testing, but in micro scale. Our goal was to separate subjective opinions from the statistics. In our belief, better design is the one liked by majority of people, because it has and advantage to appeal to more audiences. We will try however to soften our "punishment system".