"We define quality as the number of votes an article would have received if each article was shown, in a bias-free way, to an equal number of users."

I haven't yet the whole paper yet - but isn't that ignoring other major factors like how "newsworthy" a particular link is? A low quality link might get a lot of upvotes simply because it was the first link submitted that describes an inherently interesting event.