If you allow people to rate the ratings, you come back to the original issue that people are unreliable raters.

Dislikes over likes does sound interesting though.