News for hackers. Stuff that matters.
Re:The looming (storage) bandwidth wall by obecalp on Monday September 21, 2009 @04:40PM (#835515)
Retrieving data to process and storing back to some giant "storage units" are becoming more and more obsolete. The future is google style: data is replicated and backed up at all times and you push computation to data to explore data locality.
Re:The looming (storage) bandwidth wall by pronoiac on Monday September 21, 2009 @05:28PM (#835637)
Mitigate this by keeping redundant copies on multiple servers, avoiding having similar servers with largely the same set of chunks.