News for hackers. Stuff that matters.
Re:Data Mining Hacker News: Front vs. Back by minimaxir on Tuesday October 11, 2016 @09:26AM (#12684135)
A couple years ago, I did my own analysis of all Hacker News submissions (http://minimaxir.com/2014/02/hacking-hacker-news/) and also wrote a script around that time to get all data (https://github.com/minimaxir/get-all-hacker-news-submissions... , see also a modern dataset on Kaggle derived from it: https://www.kaggle.com/hacker-news/hacker-news-posts). I only looked at the # of points as a metric for quality, so front v. back with this approach is interesting. Given the good work in this post, I may take another look at the data myself.

This is a case where the sample size used may be problematic. "425 fronts against 570 corresponding backs" (n = 995), in the grand scheme of Hacker News, is not a lot, even if statistical analysis permits it (example: the by-hour Chi-Sq test, which barely hits the 5-per-cell assumption). Given the method of collection by scraping the front page directly, this is understandable, though.

However, that presents a problem. the front-page algorithm has changed in recent months and I myself have had difficulty predicting what makes the front page and what doesn't (and what ends up making the front page hours after being submitted for no reason). With relatively new features like the second-chance pool and explicit dupe marking, there is new quality control of the front page thanks to dang/sctb. That is another issue of looking at a small subset of HN data; it does not reflect the site as a whole, although looking at more-recent data might be more beneficial for optimizing one's own posts.

Re:Data Mining Hacker News: Front vs. Back by gus_massa on Tuesday October 11, 2016 @10:12AM (#12684504)
> (and what ends up making the front page hours after being submitted for no reason).

Some post are "resubmitted" by the mods using some kind of manual curation. They appear a few hours later. I sometimes notice this with a comment in an obscure submission with 2 or 3 points that falls from the newest page, but a few hours later the submission gets to the front page and then the comment can get a few upvotes.

I think the most clear description of this by dang is in: https://news.ycombinator.com/item?id=10705926

Re:Data Mining Hacker News: Front vs. Back by metafunctor on Tuesday October 11, 2016 @09:31AM (#12684168)
It seems to me like the front page algorithm is a team of people, so there is no simple pattern to pick up.

HN has always had moderators who make decisions about content. That's what makes this site good.