You can lose points when you pick design that has less community support (less people liked it). This is to prevent situation, when someone would just kept voting on random designs. We also wanted to add an element of uncertainty when voting. When you would only be able to gain points, voting would quickly become boring.