Re:Is HN changing ? Part 2
by niyazpk on Thursday January 14, 2010 @04:43AM
(#1052264)
It is so sad that Startups category is getting less and less prominence over time.
Is HN becoming reddit? Considering the quality of articles, I would not say so. The high quality of discussions may have stayed the same too. At the same time, the graphs suggest that the topics discussed here seem to have changed a bit.
Re:Is HN changing ? Part 2
by nailer on Thursday January 14, 2010 @06:09AM
(#1052347)
"Is HN becoming reddit? "
A post with a badly rhyming version of 'The Real Slim Shady' about single founders (OK startup related, but not really insightful) was sent to the front page a few days ago.
Right now there's an article from Boingboing about putting a gun in your carry-on luggage so the TSA secure it (which is very much Reddit) and the Haiti earthquake, and genocide of natives in America (general interest yes, 'Hacker News'? No).
I've gotten into the habit of flagging non-tech related posts in the hope that will fix things.
Re:Is HN changing ? Part 2
by pxlpshr on Thursday January 14, 2010 @09:58AM
(#1052702)
I do think there has been a noticeable change but I don't think it's entirely bad. For example, a discussion around Haiti with a bunch of technologists on HN - as oppose to on Reddit - could manifest a new challenge and opportunity for another hacker that impacts the world in a meaningful way as oppose to yet-another-photo-sharing-site.
I think it's pretty inevitable that as a site grows its core focus will become diluted. I'm not entirely happy to see less startup/tech news either, and I believe there are only two solutions for that: 1. growth with it and deal or 2. convert to a private community with limited invite-only (or application based).
Re:Is HN changing ? Part 2
by jacquesm on Thursday January 14, 2010 @05:02AM
(#1052283)
As Paul Graham already explained in the first installment of this analysis the biggest part of the change is due to a repositioning of the site early on.
The more recent change can not be attributed to that though.
Another important thing to note is that since these are all relative sizes it does not say that in an absolute sense there is less startup stuff, in an absolute sense it is most likely more due to the increased posting volume.
or various stuff not well related to those guidelines at all. A trend within that category probably does more to change the general flavor of HN than the observed relative size changes of some of the specified categories.
Re:Is HN changing ? Part 2
by tdoggette on Thursday January 14, 2010 @07:09AM
(#1052403)
In case it wasn't clear yet, the 'units' for the axis are simply the rank number of the postings, 1000 postings vertically, blocks of 1000 postings horizontally. That makes the time-axis non-linear.
No, it wasn't. Why aren't these graphs labeled? They make no sense without knowing what they are already.
Re:Is HN changing ? Part 2
by tdoggette on Thursday January 14, 2010 @09:55AM
(#1052696)
It's not that the necessary information isn't communicated-- it is. The problem is that there's a complicated graph that's the main content of the page, and it lacks a title and axis labels.
Re:Is HN changing ? Part 2
by chris123 on Thursday January 14, 2010 @05:50AM
(#1052327)
If you don't change, you die. But I hear ya. It like when your favorite neighborhood or neighborhood establishment gets "discovered" and it's character changes forever. That's the nature of things, the good, bad, and ugly.
Re:Is HN changing ? Part 2
by marknutter on Thursday January 14, 2010 @12:17PM
(#1053042)
This highlights the fundamental problem of social bookmarking/voting sites: the more people that join the site, the lower the common denominator of the content gets. I've seen it happen to Digg and Reddit, and it is bound to happen to Hacker News at some point. It makes me wish that there could be groups formed within these websites that are kept small, and you would only see stories that are voted on by those members. This would be different than the sub-reddits solution because it would apply to all content, not just a specific category.
Re:Is HN changing ? Part 2
by yannis on Thursday January 14, 2010 @05:08AM
(#1052291)
Just a little less of mainstream would be nice! I don't mean things like what is happening with Google and China right now but in general there is too much mainstream.
If anything that is a really good indication how big the karma inflation really is.
Dfranke spent a lot of time and effort to come up with a brilliant hack, used every trick in the book and was rightfully the top HN posting of all times.
A virtually unknown HN users posts a blog posting from googles official blog and aces the previous #1 (and will probably go up a lot further still).
So much for the theory that submissions get voted up to 'what they're worth'.
Re:Is HN changing ? Part 2
by davidw on Thursday January 14, 2010 @06:03AM
(#1052341)
I have started paying attention to this: I tend to vote up people who have done something, whether it's a company, a cool hack, or something along those lines. If a "blah blah" post like the Google one has already got a lot of votes, I'll tend not to vote for it (especially since there's no classification filter or anything like that), even if I like it.
I also tend not to vote for stuff if it's already in the top 5 spots - what's the point? I'd rather let other things bubble up.
Re:Is HN changing ? Part 2
by jacquesm on Thursday January 14, 2010 @06:15AM
(#1052356)
That's pretty close to how I upvote submissions as well.
I also upvote Ask HN style postings if they are anywhere near on topic because I think that's a great use of the community (most of the time), and I try to answer them whenever I can.
Re:Is HN changing ? Part 2
by ErrantX on Thursday January 14, 2010 @05:52AM
(#1052329)
A virtually unknown HN users posts a blog posting from googles official blog and aces the previous #1 (and will probably go up a lot further still).
So much for the theory that submissions get voted up to 'what they're worth'.
I'd say that is proof that who the poster is doesn't factor into how people are voting on a threads worth. I'd call dfranke's thread an exception to that rule.
(it depends on your feeling of worth; the HN hack was extremely impressive and clearly, locally, worth lots of votes and kudos. On the other hand the Google announcement is huge news for lots of the tech world :) )
Re:Is HN changing ? Part 2
by jacquesm on Thursday January 14, 2010 @05:57AM
(#1052334)
Yes, but knowing about it was pretty much unavoidable.
It is about as mainstream as it gets. Not that I didn't get a few valuable insights from the discussion here but still, HN is interesting because it has the other stuff, not the mainstream stuff. (or maybe both?)
Re:Is HN changing ? Part 2
by robryan on Thursday January 14, 2010 @05:59AM
(#1052339)
There are definatly a lot more people now, stuff of limited interest can pull 100 or more upvotes, I guess a better way to compare would be upvotes / active users.
The graph should only count things that have reached at least 50 karma, or even maybe 100 recently.
Re:Is HN changing ? Part 2
by elblanco on Thursday January 14, 2010 @08:44PM
(#1054041)
I think perhaps a more interesting way of looking at this is to simply take a category, plot all of the posts over the pseudo-time x-axis, then calculate a least squares trend line for that category.
Categories that slope down on shrinking, and categories that slope up are growing.
In the end, a graph isn't even necessary, just a list of categories ordered by slope.
Re:Is HN changing ? Part 2
by paraschopra on Thursday January 14, 2010 @07:44AM
(#1052450)
Hi James,
If you would like to automatically classify HN Posts into relevant category, please feel free to use our ContextSense API - http://www.wingify.com/contextsense/
PS: I'm not writing this to promote the product (because it is not actively marketed in the first place)
Re:Is HN changing ? Part 2
by gopher on Thursday January 14, 2010 @08:40AM
(#1052538)
I've left HN some time ago, when I came back here today, I've seen three PHP stories on the front page. I'd say: yes, it changes. But I must credit one PHP story was on Pharen, "A lispy language that compiles to PHP".
Re:Is HN changing ? Part 2
by jacquesm on Thursday January 14, 2010 @05:29AM
(#1052312)
There are two more steps in this series, the first is concentrating on the increase in volume over time, in terms of users, postings and karma inflation, the step after that is vocabulary analysis of the titles.
I'll put in a cut-off on noise words and one on obscure terms, the part in the middle should give some idea about trends.
I'm surprised how much work it is to do all this, I figured I'd just slap it together in a day or two but it has been a full week now.
Re:Is HN changing ? Part 2
by jacquesm on Thursday January 14, 2010 @02:47PM
(#1053421)
I know what a log chart is and how to make one, it's just that I fail to see how making either a time axis or a per-mille axis logarithmic will clarify things.
Is HN becoming reddit? Considering the quality of articles, I would not say so. The high quality of discussions may have stayed the same too. At the same time, the graphs suggest that the topics discussed here seem to have changed a bit.
A post with a badly rhyming version of 'The Real Slim Shady' about single founders (OK startup related, but not really insightful) was sent to the front page a few days ago.
Right now there's an article from Boingboing about putting a gun in your carry-on luggage so the TSA secure it (which is very much Reddit) and the Haiti earthquake, and genocide of natives in America (general interest yes, 'Hacker News'? No).
I've gotten into the habit of flagging non-tech related posts in the hope that will fix things.
I think it's pretty inevitable that as a site grows its core focus will become diluted. I'm not entirely happy to see less startup/tech news either, and I believe there are only two solutions for that: 1. growth with it and deal or 2. convert to a private community with limited invite-only (or application based).
The more people frequent HN the more submissions there will be on any subject, startups included.
But those articles have to compete for attention with all the other ones.
The more recent change can not be attributed to that though.
Another important thing to note is that since these are all relative sizes it does not say that in an absolute sense there is less startup stuff, in an absolute sense it is most likely more due to the increased posting volume.
This just documents the change of the 'mix'.
http://ycombinator.com/newsguidelines.html
or various stuff not well related to those guidelines at all. A trend within that category probably does more to change the general flavor of HN than the observed relative size changes of some of the specified categories.
Probably a more in-depth analysis of the content of the pages linked to would give more insight in to that.
No, it wasn't. Why aren't these graphs labeled? They make no sense without knowing what they are already.
http://news.ycombinator.com/item?id=639976
If anything that is a really good indication how big the karma inflation really is.
Dfranke spent a lot of time and effort to come up with a brilliant hack, used every trick in the book and was rightfully the top HN posting of all times.
A virtually unknown HN users posts a blog posting from googles official blog and aces the previous #1 (and will probably go up a lot further still).
So much for the theory that submissions get voted up to 'what they're worth'.
I also tend not to vote for stuff if it's already in the top 5 spots - what's the point? I'd rather let other things bubble up.
I also upvote Ask HN style postings if they are anywhere near on topic because I think that's a great use of the community (most of the time), and I try to answer them whenever I can.
I'd say that is proof that who the poster is doesn't factor into how people are voting on a threads worth. I'd call dfranke's thread an exception to that rule.
(it depends on your feeling of worth; the HN hack was extremely impressive and clearly, locally, worth lots of votes and kudos. On the other hand the Google announcement is huge news for lots of the tech world :) )
It is about as mainstream as it gets. Not that I didn't get a few valuable insights from the discussion here but still, HN is interesting because it has the other stuff, not the mainstream stuff. (or maybe both?)
The graph should only count things that have reached at least 50 karma, or even maybe 100 recently.
Categories that slope down on shrinking, and categories that slope up are growing.
In the end, a graph isn't even necessary, just a list of categories ordered by slope.
If you would like to automatically classify HN Posts into relevant category, please feel free to use our ContextSense API - http://www.wingify.com/contextsense/
PS: I'm not writing this to promote the product (because it is not actively marketed in the first place)
Thanks, that's nice of you!
I've been working for a long time on a hobby project that may one day be a little more serious called autotagger.
It's main function is to detect the subject of a text automatically given the text, but the titles are too small for it to function reliably.
Do you have some kind of formula for your software that will give you confidence based on the length of the sample text ?
I'll put in a cut-off on noise words and one on obscure terms, the part in the middle should give some idea about trends.
I'm surprised how much work it is to do all this, I figured I'd just slap it together in a day or two but it has been a full week now.
So much for those 'weekend' projects...
Here's a nice write up: http://www.health.state.pa.us/hpa/stats/techassist/arithlog....