Re:As Digg Struggles, VP Of Engineering Is Shown The Door
by pavs on Tuesday September 07, 2010 @08:28PM
(#1670628)
According to reddit admins some of the recent downtimes in the last few months were due to cassandra and they were having some bad performance and stability issues. I can look it up if anyone is interested but it will be a bit of a work, since they stated it (several times) in the comment section and perhaps once on a blog post too.
[ Parent
| on HN ]
Re:As Digg Struggles, VP Of Engineering Is Shown The Door
by jbellis on Tuesday September 07, 2010 @09:53PM
(#1670746)
The cassandra issues were primarily ops failures, and secondarily an older version of Cassandra making it difficult to recover once it was overwhelmed. (Some of the resulting improvements in Cassandra are documented here: http://www.riptano.com/blog/whats-new-cassandra-065)
Cassandra looks to be working fine for reddit now: http://blog.reddit.com/2010/08/everything-went-better-than-e...
Re:As Digg Struggles, VP Of Engineering Is Shown The Door
by pavs on Tuesday September 07, 2010 @11:54PM
(#1670968)
This could very well be, I remember one of the problems they were having is not having enough resources for cache or something similar. But I could be wrong I will ask them on twitter and see if they can comment here on it.
Re:As Digg Struggles, VP Of Engineering Is Shown The Door
by ketralnis on Wednesday September 08, 2010 @02:09AM
(#1671191)
> Cassandra looks to be working fine for reddit now
Yep
Re:As Digg Struggles, VP Of Engineering Is Shown The Door
by ketralnis on Wednesday September 08, 2010 @02:02AM
(#1671173)
That would be me, and you're misquoting me.
I screwed up our Cassandra deployment, and wrote about how I screwed it up. We were under-provisioned, and the version we were using didn't deal with the case of being overloaded in a graceful way. We're no longer under-provisioned, so I don't know if more recent versions deal with it better.
We've never claimed to have performance issues, I don't know where you're getting that one.
Re:As Digg Struggles, VP Of Engineering Is Shown The Door
by pavs on Wednesday September 08, 2010 @02:09AM
(#1671188)
yup faulty memory, I tried to be more clear here: http://news.ycombinator.com/item?id=1670968
No malicious intent, after all, I did ask you for verification on twitter, linking here.