This sounds a bit complicated, and I would naively assume that some people would upvote low-quality content that is likely to reach the frontpage (which reinforce the cycle).

How about checking algorithmically how reliable users are, and weighting their votes that way? The manual redemption of correct-upvotes and acquisition of downvote-shares seems a bit much in my view.