News for hackers. Stuff that matters.
Re:How Tarsnap uses Amazon Web Services by jrockway on Sunday December 14, 2008 @12:34PM (#397456)
Just out of curiosity, why such small blocks?
Re:How Tarsnap uses Amazon Web Services by cperciva on Sunday December 14, 2008 @12:52PM (#397480)
There are several advantages and disadvantages to different block sizes; but most significantly, larger blocks would make tarsnap less efficient at identifying duplicate data in the (very common) case where part of a file is modified. In the end it came down to weighing all the factors and picking a value which worked well.