I wonder if that asymmetry is part of the problem. There's a large population of users who can push junk to the top of the page, and a much smaller population with the ability to downvote it.