News for hackers. Stuff that matters.
Re:Ask HN: Anyone used Amazon EC2 with a database or other h... by jbellis on Sunday November 15, 2009 @02:21PM (#943222)
I work on the Cassandra distributed database for Rackspace. A _lot_ of people start out trying Cassandra on EC2 but the universal conclusion has been that I/O performance is miserable.

Anecdotally, Rackspace Cloud Servers I/O works much better, although the only serious head-to-head comparison I have seen is this one: http://pl.atyp.us/wordpress/?p=2240 (tl;dr: < 20MBps on writes with local storage or EBS on EC2 vs 100MBps+ on RCS)

Re:Ask HN: Anyone used Amazon EC2 with a database or other h... by JoelPM on Monday November 16, 2009 @12:46AM (#944001)
At OpenX we're using Cassandra on EC2 and it has served our needs well so far. Our use case is a little different in that we set hard timeouts on the client side reads and can tolerate a small percentage of requests that don't complete in time.

According to Amazon the I/O depends on the instance type (http://aws.amazon.com/ec2/instance-types/) so the OP may want to take that into consideration when picking an instance type.

Re:Ask HN: Anyone used Amazon EC2 with a database or other h... by JoelPM on Monday November 16, 2009 @11:44AM (#944688)
Unfortunately, last night I completely failed to remember that Rackspace and EC2 are direct competitors in this space so what was intended to be a simple data-point may be construed as more than that - my apologies.

What I intended to say was "you can make Cassandra work on EC2." However, if the I/O throughput of EC2 is a fraction that of some other provider, you'll need more machines in EC2 to achieve the same throughput.

My personal site is hosted on the Rackspace Cloud and I've been very pleased with it, but my workload is different so I can't give a comparison.

I also know that we've benefited directly from jbellis' support on IRC and the mailing list, so this should be considered an endorsement of Cassandra, if anything.

Re:Ask HN: Anyone used Amazon EC2 with a database or other h... by jbellis on Friday November 20, 2009 @08:37AM (#952359)
Of course no offense taken. Glad EC2 is working out for your workload. :)
Re:Ask HN: Anyone used Amazon EC2 with a database or other h... by paraschopra on Monday November 16, 2009 @01:56AM (#944060)
I had heard you were using MySQL as database earlier. What made you switch to Cassandra? Just curious.
Re:Ask HN: Anyone used Amazon EC2 with a database or other h... by JoelPM on Monday November 16, 2009 @11:47AM (#944693)
We're using both. Existing MySQL back-ends are still there, but for new development that can leverage a distributed key-value store we're using Cassandra.