I agree with that. I too was curious about why someone downvoted a comment I made the other day. I can honestly say I don't worry about losing a point over that since I've not looked into how points work much but I thought it was odd that someone would do that without explaining what motivated them.