News for hackers. Stuff that matters.
Re:Pack: A New Container Format for Compressed Files by iscoelho on Friday March 22, 2024 @04:25PM (#39794457)
Not that rare at all. Take a full disk zip/tar of any Linux/Windows filesystem and you'll encounter a lot of small files.
Re:Pack: A New Container Format for Compressed Files by darby_eight on Friday March 22, 2024 @04:30PM (#39794504)
Ok? How are you comparing these systems to the benchmark so they might be considered relevant? Compressing "Lots of small files" describes an infinite variety of workloads. To achieve anything close to the benchmark you'd need to specifically only compress only small files in a single directory of an average small size. And even the contents of those files would have large implications as to expected performance....
Re:Pack: A New Container Format for Compressed Files by iscoelho on Friday March 22, 2024 @05:53PM (#39795254)
My comment is not making any claims about that. It's just a correction that filesystems with "81k 1KB files" are indeed common.
Re:Pack: A New Container Format for Compressed Files by darby_eight on Saturday March 23, 2024 @02:08PM (#39801904)
If that were true, surely it would make sense to demonstrate this directly rather than with a contrived benchmark? The issue is not the preponderance of small files but rather the distribution of data shapes.