Individuals publishing psuedonymous moderation would provide the necessary data, provided privacy concerns can be addressed.

I.e. as I upvote your comment, I publish the info that "user XYZ upvoted this comment" which you can use in your own user-local moderation schema (at your discretion).

What we have to avoid is when Potential Employer looks for info on "John Q. Smith", they can identify which articles he upvoted.