Assuming they have basic protections to stop malicious users massively-downvoting stories they don't like? The number of [real] users rating the story improves the balance, and you can use the same system they do now to prevent voting by brand-new users, things like that.