Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl...
by ectopod on Sunday September 05, 2021 @05:55AM
(#28422884)
You could losslessly translate PDFs with compression to PDFs with no compression (bitmap images excepted), tar them up and compress the lot. This would get you a fair bit of gain for little pain.
However, I guess they use .zip STORE because it's fairly robust against minor corruption.
You could write a custom compressor that decompiles journal PDFs to valid TeX, then compresses that.
Or at the simpler end of what's technologically possible, you could at least extract shared assets such as fonts that appear in multiple files. Keep files from the same journal together to find more overlaps.
I suspect there's quite a large gain to be had from further compression, at least theoretically. Even more if you could accept some level of non-semantic loss.