News for hackers. Stuff that matters.
Re:Why does digg need so many servers? by tibbon on Wednesday October 13, 2010 @11:49AM (#1787523)
Just as perplexing, why do they need ~68 employees (http://about.digg.com/team).

My counting may be off by 1-2, but last I checked Reddit is coming up on them traffic-wise (http://siteanalytics.compete.com/reddit.com+digg.com/), and only has 7 employees? And I'm pretty sure Reddit doesn't have 500 servers either, although I could be wrong.

Both sites offer very similar functionality.

While past its peak, Slashdot only has 18 servers. (http://slashdot.org/faq/tech.shtml#te050)

Re:Why does digg need so many servers? by Lewisham on Wednesday October 13, 2010 @12:14PM (#1787635)
My understanding (which is, to say, belief built up over watching the companies from outside) is that Reddit is currently running what could best be described as a skeleton crew: Conde Nast won't fund them, so they're just trying to keep the ship afloat and don't have time for anything else.

Digg has scaled to the size of a company that, for a couple of years now, has considered itself just on the tipping point of "something big happening." As in there being a sea change in the way everyone consumes their news, and Digg is at the center. You'll need lots of employees when that happens, right? I think Digg has partly grown fat due to non-existent leadership; the struggle between Jay Adelson and Kevin Rose was been well-documented, and having your two lead guys check out for at least a year is not a good way to run a business. A lot of the people there are "sales", which I guess helps Digg stay profitable, but I don't really think you need as many as they have. Five community managers on a community that is supposed to manage itself is also excessive.

I expect the truth of the matter lies somewhere in the middle of Reddit and Digg. More than Reddit so you're not stagnant, less than Digg so you're not fat.

Re:Why does digg need so many servers? by ianb on Wednesday October 13, 2010 @01:37PM (#1788058)
Everything that is cool about Reddit at this point is what Redditors are doing with Reddit, not what Reddit is doing with its site. And isn't that how social media is supposed to work? Not just some notion that users are tools, that you'll crowdsource your way to being yet-another-traditional-media source (except without journalists)... social media should be individuals forming their own communities... communities of interest, communities of practice, communities of support -- all of which exist in Reddit (/r/SuicideWatch both disturbs and impresses me).

So the fact Reddit-the-software isn't changing that much doesn't seem like that big an issue, it's more like infrastructure. A major redesign would be negatively disruptive to the communities that are building there. Not that there aren't great things Reddit could do but isn't, but I think they are doing well at the most important stuff. If Reddit had 68 employees they not only would be fat, they'd probably fuck up a good thing.

Re:Why does digg need so many servers? by Lewisham on Wednesday October 13, 2010 @03:14PM (#1788461)
Do not take my comment to mean I'm anti-Reddit, I like Reddit way more than I ever did Digg :) But Reddit doesn't really do a lot apart from keeping everything going.

I agree that altering Reddit now is probably not a good idea, and they don't need a large headcount, but it's good that Reddit isn't answering to shareholders directly, because if it wasn't for Digg's implosion, their growth would have been far too slow.

Re:Why does digg need so many servers? by tibbon on Wednesday October 13, 2010 @01:04PM (#1787882)
But that's the funny thing, is the Reddit is growing and Digg is shrinking- despite their staffing. Reddit does a much better job at allowing the community to manage themselves on a volunteer basis with the moderators/admins of the subreddits than Digg.
Re:Why does digg need so many servers? by rythie on Wednesday October 13, 2010 @12:25PM (#1787685)
My guess is that Reddit won't be able to innovate much with that level of staffing, they are basically just keeping it running - but maybe that's ok, since they have already been bought. Slashdot has been the same for a long time too, but they are also not looking for a big exit.

Digg has had $40m in funding [http://www.crunchbase.com/company/digg] and so unless it sells for $200m+ the investors will most likely see it as failure. Kevin Rose seems to be advising people to take less money [http://www.zdnet.com/blog/weblife/kevin-rose-10-tips-for-ent...] or no money, presumably because Digg was over-funded, at least for it's current position.

Re:Why does digg need so many servers? by bmm6o on Wednesday October 13, 2010 @12:29PM (#1787705)
Absolutely. Every time someone trots out "And Reddit only has 7 guys", I think to myself that they're innovating as if they had 3. Say what you will about Digg, but at least they rolled out new software.
Re:Why does digg need so many servers? by neilc on Wednesday October 13, 2010 @01:19PM (#1787965)
Say what you will about Digg, but at least they rolled out new software.

Digg is a discussion site, not an operating system -- what is the value in "rolling out new software"?

Digg's value is in the quality of the discussion and community; "innovation" that doesn't improve that is pointless. Look at HN: it remains nearly as minimalist as always, and mostly receives occasional tweaks and performance improvements.

Re:Why does digg need so many servers? by nervechannel on Wednesday October 13, 2010 @01:37PM (#1788061)
Quite -- it was innovation that killed Digg wasn't it?
Re:Why does digg need so many servers? by slantyyz on Wednesday October 13, 2010 @02:43PM (#1788318)
I'm of the view that the growth and community killed Digg.

Once Digg hit critical mass, they were killed by the signal to noise ratio. I stopped visiting the site a couple of years ago because of that.

The reason why HN thrives is that the signal to noise ratio is still quite high, and while there is diversity in the submissions, you can probably group them into a few common themes.

Re:Why does digg need so many servers? by bmm6o on Wednesday October 13, 2010 @06:31PM (#1789150)
Sure, you can argue that they would have been better off not rolling out new software, or that they don't need new features. I'm just saying that the answer to the (sometimes implicit) question of "why does Digg have so many more people than Reddit" is that some of them are designing features and writing code, and there doesn't seem to be much of that going on at Reddit.

Personally, I'm in general agreement with you. And you can rebase the whole argument: take MetaFilter, with 4 people on the payroll (and not all technical). What is everyone at Reddit doing?

Re:Why does digg need so many servers? by WesleyJohnson on Wednesday October 13, 2010 @01:41PM (#1788078)
I would agree that I love HN's minimalist approach, but the end game for HN and Digg are vastly different, aren't they?

I think the perceived value of rolling out new software is that Digg had hoped it would draw in more uses and entice existing users to become more active. If you're running a website that is largely user generated content and is also stagnant, how do you inject new life into it without adding new features? I'm genuinely curious.

Re:Why does digg need so many servers? by ojbyrne on Wednesday October 13, 2010 @12:27PM (#1787695)
Where is Kevin advising people to take less money? If you mean the $80 million comment, that was almost certainly before the Series C, so digg had less than half the funding.
Re:Why does digg need so many servers? by rythie on Wednesday October 13, 2010 @12:33PM (#1787724)
Re:Why does digg need so many servers? by ojbyrne on Wednesday October 13, 2010 @12:43PM (#1787776)
For someone who took $ x million "off the table," during those funding rounds the hypocrisy is impressive.
Re:Why does digg need so many servers? by Lewisham on Wednesday October 13, 2010 @03:17PM (#1788467)
Since when did "experience" == "hypocrisy"?
Re:Why does digg need so many servers? by ojbyrne on Wednesday October 13, 2010 @03:48PM (#1788588)
Huh? Kevin sold several million dollars worth of stock, enabled by raising more money than needed, and gave up more control to do it. Now he advocates that others raise as little money as possible. How is that "experience?"
Re:Why does digg need so many servers? by thecoffman on Wednesday October 13, 2010 @12:16PM (#1787641)
Yes, it blows my mind that digg needs so many employees. Reddit actually is larger than digg (http://www.readwriteweb.com/archives/reddit_to_mainstream_me...), and until recently had even less than 7 employees. If I'm not mistaken they have 3 programmers and a systems admin. Kind of makes you wonder what all the digg employees do all day.
Re:Why does digg need so many servers? by jshen on Wednesday October 13, 2010 @12:53PM (#1787824)
"Kind of makes you wonder what all the digg employees do all day."

Communication. I'm always surprised that so few people who do software (I'm talking management at companies) are familiar with the mythical man month. Adding employees to a software project always yields diminishing returns due to the increase in communication required.

Re:Why does digg need so many servers? by noodle on Wednesday October 13, 2010 @12:00PM (#1787571)
reddit uses something like 250-300 EC2 nodes.
Re:Why does digg need so many servers? by tibbon on Wednesday October 13, 2010 @12:06PM (#1787591)
Unless they are using the really big instances though, I find that EC2 nodes are generally lower in power compared to what most people are using for their servers.

I remember not too long ago before they moved to EC2 everything fit in just a few racks. Of course, their traffic has expanded significantly recently.

Re:Why does digg need so many servers? by ergo98 on Wednesday October 13, 2010 @12:42PM (#1787767)
EC2 nodes are terribly underpowered, particularly in the I/O realm (the biggest weakness of virtually every site) where a standard desktop absolutely annihilates the I/O performance of an S3 connection (where you have to perform software RAID to get anywhere near the performance of a single magnetic low-end SATA drive, which is absolutely terrible).

A lot of the "web scale" noise has come from dealing with these gerbil sized instances.