Looking at one machine available:
* / has 2.08 compression ratio,
* /var/cache 2.15
* /var/tmp 1.0
* /home 1.02
* /srv 1.10 (few web apps, pgsql instance for these web apps, svn repo, samba shares, local prometheus store).
If your server uses spinning rust, you can also increase the I/O by using compression. You are trading the CPU time for I/O bandwidth. Depending on your workload, it may be a sensible trade-off.
But still wondering: does the amount of this data really warrant compression? I mean the smallest sensible size of an SSD is around 100GB and it has lots of performance.
The compression was just something nice to have. Lz4 in filesystem is basically for free.
My first test of PostgreSQL on ZFS was also quite instructive. lz4 again achieved respectable compression (>10× for my datasets) and improved throughput several fold (with no other tuning!).