Personally I just downvote someone immediately when they mention anything about being downvoted in their post. It's called losing the game.