I'm not sure if you're mocking me or giving me too much credit here..
Really I was hoping to be more rigorous and go more in depth but at some point it just felt silly to hammer a website, scrape the page and never have access to the whole data. Doing this got me thinking about issues like "time of day" though as there must be a way to take into account the rate of new posts and make old posts more 'sticky' when the rate accelerates, in the morning for instance.
I feel like starting my own social news website just to have a play with different algorithms!
"I'm not sure if you're mocking me or giving me too much credit here."
Neither, I'm sure.
(Funny. lately when I get sarcastic here, people think I'm serious, and when I'm serious, people think I'm joking. I guess I need a little more practice writing to strangers.)
Scatter diagrams are one of the greatest underrated ways of conveying information in a heartbeat. You've done a great job of it.
You've also opened up a can of worms. There are so many ways to look at this data, you can keep yourself busy for quite a while. I suspect that won't be a problem, considering how much you already care about this. Keep up the good work and keep us posted.
You've certainly embodied the philosophy of Edward Tufte:
http://www.amazon.com/s/ref=nb_ss_gw/102-8193666-1218533?url...
There must be many cofactors that are hard to capture in an analysis like this. There's the "binaryness" of making it to the front page. There's also "time of day". A very interesting submission posted at a time when those who would be interested are not online may never gain enough traction to make it to the first page. A time-of-day analysis would certainly be interesting.