To a large extent, yes. Try not to worry about it, they still help sort more interesting comments to the top.

(I gave you a net 0, upvoting your comment and downvoting your complaining)