News for hackers. Stuff that matters.
Re:How Tarsnap uses Amazon Web Services by andr on Sunday December 14, 2008 @08:03AM (#397345)
How exactly do you batch writes? Do you save 2 blobs in 1 file? Or some kind of keep-alive that Amazon counts as a single request?
Re:How Tarsnap uses Amazon Web Services by cperciva on Sunday December 14, 2008 @10:31AM (#397393)
I aggregate blobs together (up to 4 MB at once) and store them to S3 as a single S3 object. The tarsnap server keeps track of which part of the object corresponds to which blob.