News for hackers. Stuff that matters.
Re:Amazon Web Services are down by epi0Bauqu on Thursday April 21, 2011 @11:58AM (#2471093)
How do you move away from EBS and still deal with large data?
Re:Amazon Web Services are down by obfuscate on Thursday April 21, 2011 @04:15PM (#2472184)
Not sure what you had in mind by "large", but instance storage goes up to 1.7TB: http://aws.amazon.com/ec2/instance-types/
Re:Amazon Web Services are down by Devilboy on Thursday April 21, 2011 @08:25PM (#2472893)
The reason Reddit uses RAID10 is for performance, not disk size. A single instance storage device is just too slow for the Reddit database.
Re:Amazon Web Services are down by obfuscate on Friday April 22, 2011 @03:31AM (#2473495)
Many instance types have 2 or 4 virtual disks (presumably on different physical disks).
Re:Amazon Web Services are down by joshhart on Thursday April 21, 2011 @01:22PM (#2471438)
I imagine they'd do consider some combination of the following (sorted by most likely)

1. Sharding data 2. Pulling tables out to other servers from the main DB 3. Pruning excessive data 4. Compressing data

Re:Amazon Web Services are down by jjm on Thursday April 21, 2011 @01:58PM (#2471587)
It still has to be stored somewhere though right? If it's EBS you've just made yourself a complicated solution that will eventually fail all over again. No?
Re:Amazon Web Services are down by joshhart on Thursday April 21, 2011 @03:42PM (#2472053)
If the data is sharded, then the data/server is small enough enough to fit within the individual server's disk and you no longer need EBS to store it.