News for hackers. Stuff that matters.
Re:Windows file system compression had to be dumbed down by Alupis on Tuesday November 01, 2016 @12:32PM (#12847404)
Because it must be compressed first, a cpu intensive task, which slows the already slow disk I/O.
Re:Windows file system compression had to be dumbed down by foota on Tuesday November 01, 2016 @12:43PM (#12847555)
I think a cpu can compress data (provided it's in memory) orders of magnitude faster than it can write to disk. Now that I think about it though, the context would be necessary to compress well, so maybe you would need to read surrounding data.
Re:Windows file system compression had to be dumbed down by Alupis on Tuesday November 01, 2016 @12:48PM (#12847622)
Compress any larger piece of data on your own computer, and watch the CPU bottleneck.

Even on the fastest CPU's, writing a file that must be compressed first, will always be slower than the same file on the same hardware, but not being compressed before written to disk.

It may not be magnitudes slower - depending on the data, hardware, and algorithm, of course - but it will incur some write penalty. So, with disk compression, you get a write penalty and a read boost.

Re:Windows file system compression had to be dumbed down by cmurphycode on Tuesday November 01, 2016 @03:13PM (#12849176)
You are correct that most compression algorithms are slower than their corresponding decompression, which means the writes tend to be a different tradeoff than the reads.

I do not agree with your statement that compress + write is always slower, though. The analysis for cost/benefit of compression is the exact same logic for both reads and writes, but with different formulas based on how fast you can compress/decompress and read/write blocks. Let's imagine that your disk takes 10ms to write 64KB and 20ms to write 256KB. Then if compression of a 256KB block down to 64KB takes 5ms, writing is faster with compression done first. On the other hand, if compressing it takes 50ms, then writing it raw is quicker.

Re:Windows file system compression had to be dumbed down by ThrustVectoring on Tuesday November 01, 2016 @04:34PM (#12849792)
Whether it's a penalty or boost for reading or writing is entirely dependent on the performance characteristics of reading, writing, compressing, and decompressing. I can think of a reducto ad absurdum that's a write boost and a read penalty - I/O is carving and reading text from a stone tablet, compression is looking up shorthand from a dictionary.