News for hackers. Stuff that matters.
Re:Windows file system compression had to be dumbed down by LeifCarrotson on Tuesday November 01, 2016 @12:57PM (#12847721)
> my steamapps folder saving 20% disk space even with the not-very-good compression that NTFS offers

Wait, you run the Steam apps from a compressed folder? Doesn't that kill performance?

Regardless, I have long felt that the right way for Steam to make this work would be to have, in addition to the "Download" and "Delete" tools, an "Archive" button that moves it to a specified path (by default, on the install drive, but configurable to another drive or a NAS) and compresses it - with whatever compression they want.

I want my Steam apps uncompressed on my SSD. I don't have room on my SSD for hundreds of gigabytes of Skyrim textures that I haven't played in 6 months. But if I delete the app, then I have to wait hours (and cause Steam some expense) to download it again.

Not everyone has multiple drives or a NAS, but a local archive would definitely be useful.

Re:Windows file system compression had to be dumbed down by outworlder on Tuesday November 01, 2016 @03:29PM (#12849293)
> Wait, you run the Steam apps from a compressed folder? Doesn't that kill performance?

No. In fact, it may improve performance, by virtue of transferring less data from slower I/O devices. Yes, slower, even if it's a SSD.

Re:Windows file system compression had to be dumbed down by TillE on Tuesday November 01, 2016 @07:45PM (#12851161)
> Yes, slower

I'm skeptical of this actually being the case in any real-world scenarios. There have been a number of tests of running games from a RAM disk vs an SSD, with precious little difference in load times.

Re:Windows file system compression had to be dumbed down by mitchty on Wednesday November 02, 2016 @12:45AM (#12852310)
It depends on the data generally, but algorithms like lz4 can decompress faster than most storage mediums can keep up. Including nvme drives. Compare 1.8GiB/s reads of raw data, versus compressed almost 3 or more. This is on a skylake i7 and 2 nvmex4 drives. More cpu use but honestly, it would be stalled waiting on i/o otherwise.

The key is the data sent to the cpu and decompressed, makes up for the stall from hitting memory or i/o. Comparing ram vs ssd is the wrong comparison to make, with both you're hitting stalls due to memory. You want to compare reads of uncompressed versus compressed with the note that (and i'm just making numbers up with this analogy as i'm about to sleep), 900KiB of compressed data in, 2MiB of data out. 1.1MiB bonus and yes I'm assuming huge compression but for times your cpu is idle it makes perfect sense.

And yes, lz4 compression on things like movies still helps. I shaved off over 200GiB on my home nas with zfs.

Re:Windows file system compression had to be dumbed down by sparky_ on Tuesday November 01, 2016 @08:21PM (#12851335)
I would love a benchmark comparing this with and without compression! Very interesting possibility to deal with the 4TB game library problem :p
Re:Windows file system compression had to be dumbed down by detaro on Tuesday November 01, 2016 @12:59PM (#12847766)
You can use Steam's backup feature for that, at least for games that manage their updates through Steam: https://support.steampowered.com/kb_article.php?ref=8794-YPH...

Also useful if you don't have fast internet for your gaming PC, but access to it somewhere else.

Re:Windows file system compression had to be dumbed down by wbkang on Tuesday November 01, 2016 @01:36PM (#12848199)
No it does not kill performance. Decompression is a very fast operation. I have all of my drives compressed, it is fine.
Re:Windows file system compression had to be dumbed down by btym on Tuesday November 01, 2016 @08:14PM (#12851304)
In my case having it compressed on SSD would greatly improve performance... because my steamapps directory is on a large spinning disk due to size ;)
Re:Windows file system compression had to be dumbed down by abrookewood on Tuesday November 01, 2016 @07:29PM (#12851073)
These apps will move your Steam games for you and use Windows Junctions (links) to do so: http://www.traynier.com/software/steammover http://www.stefanjones.ca/steam/