How about meta-moderation, like what is used on Slashdot?

Logged-in users are occasionally asked to apply a few moderation points to comments, but are also subject to their moderation actions being reviewed in turn.