I think very aggressive karma decay might work. Let's say your karma that is older than 1 year does not count for moderator powers. That means you need to be actually productive member of community to have the moderation powers.