Karma-rank (Pagerank for social sites)
I won't explain how Pagerank works, there is a good explanation here:
http://www.ams.org/featurecolumn/archive/pagerank.html
Let's drop the "every vote counts equal" scheme. Say you want to get a global measure for how important every person's votes are to the site. This means you want to assign a number to every person. This is analogous to the pagerank number assigned to a web page. The votes a person has got on all his comments and submissions corresponds to the inbound links of a webpage. The votes a person gives correspond to outbound links from a webpage. You would like that the authority every user gives equals the authority every user receives (both via upvotes, let's ignore downvotes for now). Every user's importance gets divided equally among the submissions/comments that he has upmoded. These are exactly the rules Pagerank operates on, except that one user may have upmoded another several times and you need to account for downmods too.
What are the advantages this would bring to sites like news.YC? Such an algorithm would be pretty resistant to voting circles in the same way pagerank is resistant to spam (one user with lots of karma will weight more than a lot of sockpuppets with no karma). It gives a global estimate of people's importance to the site and it should allow a site to preserve it's culture better as it scales.
Drawbacks? Some people may object that it is unfair not to count votes equally. It is harder to implement (especially as you need to modify the karma-rank on the fly, although if this turns out to be hard, you can use an approximation and recalculate karma-rank daily, for example). Last but not least, it puts serious performance requirements on the site implementing it that Arc is probably not ready to handle.
ie If I think something is worth 20 karma I give it 20 of my karma. If I think something should lose 10 karma I have to pay 10 karma to remove it.
It sounds scary as it could introduce a lot of volatility. The main benefit however would be that people are a lot more judicious when voting as it comes at a price.
I'm not saying it would work but it would be bloody interesting. Obviously there would have to be a source of new karma or else we would experience deflation. It could be trialled for a month or two with an agreement to go back to the previous system and to restore previous karma levels should things go tits up.
Thoughts?
Edit: forgot to say that removes the need for any potentially large amounts of computation to calculate weightings.
Google determines global pagerank because they lack the computational horsepower to do otherwise and because web pages and users are not similar entities, but on a site like this where the links between users and articles are effectively a single measurement this sort of individual pagerank is possible.
http://news.ycombinator.com/item?id=232882
Unfortunately Pagerank is not inherently resistant to spam. To extend your metaphor, this would be good if we had a lot of "Ms. Wikipedia's" but bad if we had more than a few "Mr. Linkspam's."
It would discourage new users, as they would likely never catch up to early adopters. The A-List blogger phenomenon is a good example of this. Big, popular blogs stay big and popular. While possible, it is extremely difficult to break in to the upper echelons of blogging.
It would also reward those who post and vote on topics that are mainstream, at the expense of diversity in the community.
The normalizing effect might be particularly well suited for some specific communities - financial advisers for example, or those dealing specifically with popular culture.
Pagerank is usually log-scaled because of these feedback loop effects.
Adding a time based decay to the rank could address that. I.e. my vote for you 1 month ago is worth less then the vote 1 min ago...
Oh, by the way, we have it implemented already on jaanix. For an opensource implementation you can take a look at http://www.advogato.org/
The biggest effect is that it is discouraging trolls and spammers, as there's no front page they can spam or troll. The downside is that the critical mass required to make the site truly social is a lot higher, and unfortunately we have not figured out how to gain enough users for it to really shine.
You can make a page without recommendations the default, at least until you acquire critical mass. You can just have a "personalized" slider defaulting to no personalization.
The idea is in the shelf. If someone wants to work on that, I'd be glad to join and exchange some ideas.
As someone who is working on a system like this that can also do realtime rank adjustments I can assure you that the mechanics are simple, the hidden details are subtle, and until you have a community that is active enough for this to make a difference it is hard to say that the effort is worthwhile.
Do you want to wage a constant arms race with the exploiters? Is that really the best use of your time at a start up? Are you gonna expend the amount of resources Google expends on it and still doesn't get it perfect?
Incorporating rankings from news-voting sites (digg, yc, reddit) directly into pagerank for search.