For one, they don't even seem bothered enough to correct the "cache expired" continuation crap on the site, much less to build a new moderation system.

Second, if "poor members" get invited in large numbers, then the system you propose will fail, because they get to dictate what is good or not (by upvoting it), which will in term make them appear good (because they like/submit the 'good stuff').