Could maybe try some machine learning for moderation. I'd imagine the non-contributors share some amount of the same communication patterns.

Every time I see a problem that requires a lot of repetitive work that most people would not like to spend a lot of time doing, I always try to think of how it could be automated with computers that don't get tired