News for hackers. Stuff that matters.
Re:Caching at Reddit by eunoia on Wednesday January 18, 2017 @04:04PM (#13430255)
Some back of the envelope math for their caching costs:

54 x R3.2xlarge EC2 instances

On demand = $314,571.6/year

w/ 1 year term = $166,860/year

w/ 3 year term = $110,340/year

w/ convertible 3 year term = $150,174/year

Is that a lot? Seems like a lot

Re:Caching at Reddit by user5994461 on Wednesday January 18, 2017 @04:30PM (#13430462)
Hard to tell. Don't know how much volume they have.

Going from a 50th site in the world in a niche topic (stack overflow) to a 27th worldwide that target all audience. It's entirely possible that it grows the traffic by 100x.

Anyway, who cares about money? 100k a year is peanuts. At this scale, if you have a solution that works well, you're good. Not even worth thinking about it.

Re:Caching at Reddit by notheguyouthink on Wednesday January 18, 2017 @05:17PM (#13430879)
I mean, doesn't feel like it's working well - fwiw. The number of times i have seen reddit is down pages, ranging from maintenance, to oopsies, to slow loads and failed requests... i just can't count, they seem part of the normal reddit flow.

They're better now then they were ages ago, but it still happens. Combine that with slow load times, etcetc.

Now, don't get me wrong they're likely doing better than i could - it's a very difficult problem to solve. But, something must be fundamentally wrong if a site who's growth has been steady and not "overnight", it just seems like it's always been very very slow. By overnight i just mean, it's growth has appeared predictable; Unlike the poor sites that get HN/Reddit hug of death.

edit: Not sure why i was downvoted, but i'll elaborate:

From a user perspective, Google never goes down. It's a big event when that happens. I've never seen Amazon down (again, personally!). I've never seen most of the big players down. Yet i've seen Reddit down more times than i can count. It's a meme on the site.

Regardless of how difficult the problem domain is, the end user doesn't care. All i'm saying is that the end user experience is not good enough, in my opinion. I don't think that is an unfair statement.

So if this caching is what is powering the current state of things, what can be done better? From a technical perspective, is this the best that can be achieved? I surely hope not. Would you argue it's the best we can hope for?

Re:Caching at Reddit by brokenmachine on Wednesday January 18, 2017 @05:49PM (#13431179)
I don't know why you're getting downvoted either.

Anecdotally, I also get way more errors/dropped connections/random slowness on Reddit than on any of the other massive sites. Plus the mobile site is beyond terrible, unusable on my phone.

I'm sure it's not an easy problem to solve, but they should be able to afford some hosting with all the reddit gold that seems to get thrown around.

Re:Caching at Reddit by user5994461 on Wednesday January 18, 2017 @06:10PM (#13431373)
The other sites make tons of money.

Dunno about reddit. Do they even have a revenue model except some ads that 60% of their user block?

Re:Caching at Reddit by brokenmachine on Wednesday January 18, 2017 @06:35PM (#13431545)
Well that means 40% are viewing ads...

Also there's reddit gold but who knows how much they get from that.

Re:Caching at Reddit by griffinmichl on Wednesday January 18, 2017 @10:52PM (#13432854)
Not much.
Re:Caching at Reddit by degenerate on Wednesday January 18, 2017 @04:18PM (#13430374)
For a text link site that lets you vote submissions up and down? Yes that's a lot. I'm sure a lot of the decisions at reddit corp were along the lines of, "well, we can't go back and change that now, so let's do whatever we need to fix it and move forward" AKA lots of RAM and caching all over the place.
Re:Caching at Reddit by mwpmaybe on Wednesday January 18, 2017 @04:28PM (#13430443)
If a company is grossing $20MM/year and stands to improve that by more than 0.75% by having a faster site, then yes, it makes sense to spend 0.75% of your revenue to do so.
Re:Caching at Reddit by flashman on Wednesday January 18, 2017 @08:26PM (#13432157)
One of my favourite breeds of internet comment is "I'm sure five competent engineers could run Reddit at its current scale."
Re:Caching at Reddit by praneshp on Thursday January 19, 2017 @03:21AM (#13434063)
If you think that's all reddit is (text link, with up and down), you have to go use it a little bit. Subreddits, comments, self-hosted images, etc disagree.
Re:Caching at Reddit by mason55 on Wednesday January 18, 2017 @06:48PM (#13431613)
That's the cost of 0.5-1 FTE. To come up with a better solution it would have to be enough cheaper to reduce the engineering hours of design and build and then take zero extra people to maintain. Feels unlikely.
Re:Caching at Reddit by mozumder on Wednesday January 18, 2017 @04:48PM (#13430607)
If you build it yourself it would cost about $1.5k-2k per instance.