Re:Show HN: 10-40% faster LZMA decoder using x86 CMOVcc
by orev on Monday December 13, 2021 @12:53PM
(#29542155)
Contrary to popular belief (sadly, even among the tech crowd here), people use computers for more than just web stuff.
Re:Show HN: 10-40% faster LZMA decoder using x86 CMOVcc
by 1vuio0pswjnm7 on Monday December 13, 2021 @03:23PM
(#29544126)
IIRC, in a recent thread about zstd, someone claimed brotli was faster. Perhaps one needs to look at whether the sample being compressed is web stuff.
Re:Show HN: 10-40% faster LZMA decoder using x86 CMOVcc
by jeffbee on Monday December 13, 2021 @03:27PM
(#29544172)
If you’re too busy to check yourself, the “squash compression benchmark” page has results for dozens of codecs and different inputs.
Re:Show HN: 10-40% faster LZMA decoder using x86 CMOVcc
by skyde on Monday December 13, 2021 @01:03PM
(#29542290)
Brotli is not just for Web stuff.
Re:Show HN: 10-40% faster LZMA decoder using x86 CMOVcc
by duskwuff on Monday December 13, 2021 @01:37PM
(#29542736)
Brotli is heavily tuned for "web stuff". It's literally got a built-in dictionary full of commonly used HTML fragments:
Re:Show HN: 10-40% faster LZMA decoder using x86 CMOVcc
by sebazzz on Monday December 13, 2021 @02:38PM
(#29543490)
Shoot me, works well for the average desktop (=Electron) application then.
Re:Show HN: 10-40% faster LZMA decoder using x86 CMOVcc
by adgjlsfhk1 on Monday December 13, 2021 @03:01PM
(#29543831)
Electron is just web stuff.
Re:Show HN: 10-40% faster LZMA decoder using x86 CMOVcc
by throwthere on Monday December 13, 2021 @07:45PM
(#29546753)
Sure but it actually benchmarks well broadly maybe despite its heavy web optimizations.
Re:Show HN: 10-40% faster LZMA decoder using x86 CMOVcc
by orev on Monday December 13, 2021 @01:05PM
(#29542333)
Sure. In theory. But every other response to this comment are clearly talking about web stuff, and in practice brotli is really only used for web stuff.
Re:Show HN: 10-40% faster LZMA decoder using x86 CMOVcc
by jeffbee on Monday December 13, 2021 @01:28PM
(#29542632)
I don't know what's theoretical about it. There are Debian packages for brotli and it just behaves like a stdio codec, same as the `xz` command.
Re:Show HN: 10-40% faster LZMA decoder using x86 CMOVcc
by masklinn on Monday December 13, 2021 @01:44PM
(#29542817)
Brotli has a static dictionary heavily geared towards web formats, and there really is no reason to use brotli outside of web stuff: the point of brotli is that it has browser support and does 15~20% better than gzip.
It's not bad per-se, but if you're not constrained to the web zstd will have a better compression ratio at every throughput (and better throughput at every compression ratio), and if you want maximum compression period it's not close to competing with LZMA-based formats (xz, lzip).
Re:Show HN: 10-40% faster LZMA decoder using x86 CMOVcc
by skyde on Monday December 13, 2021 @01:46PM
(#29542845)
I think he mean is less popular (like zstandard and lz4) compared to zlib and LZMA and BZip2.
this is unfortunate because Brotli and Zstandard compress much better than zLib and LZ4 and decompress much faster than zlib lzma and LZ4
Re:Show HN: 10-40% faster LZMA decoder using x86 CMOVcc
by orev on Tuesday December 14, 2021 @12:55PM
(#29554784)
I’m using the phrase “in theory” colloquially, which means something like “sure, you could technically use it that way, but nobody really does/it’s very rare”.
Re:Show HN: 10-40% faster LZMA decoder using x86 CMOVcc
by pletnes on Monday December 13, 2021 @12:19PM
(#29541735)
Linux distros often ship xz out of the box. I’ve never seen brotli in the wild. YMMV of course - I am sure there are exceptions.
I’ve used brotli myself, but only as it’s included in some parquet read/write libs.
Re:Show HN: 10-40% faster LZMA decoder using x86 CMOVcc
by stillicidious on Monday December 13, 2021 @12:27PM
(#29541830)
Probably 10-40% of what your browser is served nowadays is brotli, it's in Chrome so all the major CDNs support it by default
Re:Show HN: 10-40% faster LZMA decoder using x86 CMOVcc
by pletnes on Monday December 13, 2021 @12:58PM
(#29542221)
I’m sure you’re right, but files-on-disk is another story. I was referring to the latter.
Re:Show HN: 10-40% faster LZMA decoder using x86 CMOVcc
by ByTheBook on Monday December 13, 2021 @03:02PM
(#29543855)
Jpeg-XL makes use of Brotli, and once it hits 1.0 it will most likely be turned on by default in browsers and thus you will probably see a lot of jxl in the wild, particularly since it provides lossless recompression to existing jpeg files with ~20% smaller size as a result.
Re:Show HN: 10-40% faster LZMA decoder using x86 CMOVcc
by throwaway1777 on Monday December 13, 2021 @12:49PM
(#29542111)
It’s definitely in use by Meta and Google.
Re:Show HN: 10-40% faster LZMA decoder using x86 CMOVcc
by GordonS on Monday December 13, 2021 @01:32PM
(#29542673)
I'm not the OP, but I took their comment to mean "on the command line".
Re:Show HN: 10-40% faster LZMA decoder using x86 CMOVcc
by peter-m80 on Monday December 13, 2021 @12:24PM
(#29541796)
cloudflare uses brotli (not sure if optional or by default)
Re:Show HN: 10-40% faster LZMA decoder using x86 CMOVcc
by rwmj on Monday December 13, 2021 @03:04PM
(#29543871)
I don't know about web use, but xz's major advantage for me is the seekable format. We build disk image pipelines based on remote xz-compressed images where only the parts of the file being accessed need to be downloaded and uncompressed. https://libguestfs.org/nbdkit-xz-filter.1.html
Re:Show HN: 10-40% faster LZMA decoder using x86 CMOVcc
by dragontamer on Monday December 13, 2021 @01:43PM
(#29542801)
But this seems like a patch given to the LZMA project, with an interesting low-level result to boot.
Your corpus may vary etc etc.