Since you're using yourself as a data point, I paged through your comment history looking for your grayed out comments. I have to say that your grayed out comments were all well deserved. They are a very small minority of your comments, but they are comments that generally involved ad hominem attacks and/or gratuitous negativity that did not add to the discussion. I would say the downvote system has worked well in these cases.