We're wasting money by only supporting gzip for raw DNA files

Re:We're wasting money by only supporting gzip for raw DNA f... by phantop on Monday January 09, 2023 @02:05PM (#34314522)

I wonder if making using of zstd's long mode (`--long`) and/or multithreading support (`-T0` to use all threads) would close the displayed performance gap with `pigz`. Doesn't seem like either were used, which is odd considering the comparison made and the file used.

[ Parent | on HN ]

Re:We're wasting money by only supporting gzip for raw DNA f... by michaelbarton on Monday January 09, 2023 @02:32PM (#34314848)

I did play with long mode and it indeed works much better. I omitted it for brevity and to drive faster the main point about gzip.

Pretrained dictionaries could also be useful too.

[ Parent | on HN ]