News for hackers. Stuff that matters.
Re:My experience with using cp to copy 432 million files (39... by thaumaturgy on Thursday September 11, 2014 @08:45PM (#8306064)
tarpipes can handle gnarly piles of hardlinked files without sweating. BackupPC is free software for network backups that builds a massively hardlinked file pool; tarpipes are the only thing that can reliably copy BackupPC pools from one location to another.
Re:My experience with using cp to copy 432 million files (39... by rbh42 on Friday September 12, 2014 @04:37AM (#8307111)
Not so. Both the sending and the receiving tar processes will need a data structure keeping track of which inodes they've already processed. They can skip inodes with a link count of 1, but if all inodes have multiple links (as in this case), the overhead will be twice that of a single cp process.