News for hackers. Stuff that matters.
Re:An LZ Codec Designed for SSE Decompression (2016) by XDirtyPunkX on Thursday May 11, 2017 @11:53PM (#14321312)
If you're interested in results, it's also worth reading the follow-up which show that on equal footings LZSSE8 is a more general choice than LZSSE2 which works well on text and in high compression scenarios (http://conorstokes.github.io/compression/2016/02/24/compress...).
Re:An LZ Codec Designed for SSE Decompression (2016) by alkoumpa on Thursday May 11, 2017 @06:09PM (#14319927)
posts involving vectorization are always nice, especially if it involves compression. I'd love to see a vectorized version of arithmetic coding, that would definitely be interesting
Re:An LZ Codec Designed for SSE Decompression (2016) by eutectic on Thursday May 11, 2017 @06:55PM (#14320205)
Re:An LZ Codec Designed for SSE Decompression (2016) by klodolph on Friday May 12, 2017 @01:52AM (#14321717)
Finite State Entropy is the leaner, faster entropy encoder that you probably want to use instead of Arithmetic coding. It's also much more likely to be something that could be made parallel--at least for encoding, Arithmetic coding traditionally uses division, and there's no SSE integer division.

But that's okay, because ANS / FSE are here.

Re:An LZ Codec Designed for SSE Decompression (2016) by gliptic on Friday May 12, 2017 @05:19AM (#14322473)
There is LZNA (http://cbloomrants.blogspot.se/2015/05/05-09-15-oodle-lzna.h...) that uses vectorization to update and query its statistical models.
Re:An LZ Codec Designed for SSE Decompression (2016) by oso2k on Thursday May 11, 2017 @06:16PM (#14319958)
This is pretty cool. It competes well with lz4 even if it is amd64 only. I wonder what an ARM version would look like. Here's to hoping he author keeps working on this.
Re:An LZ Codec Designed for SSE Decompression (2016) by XDirtyPunkX on Thursday May 11, 2017 @11:50PM (#14321298)
LZSSE author here, Evan Nemerson has started a portable version of LZSSE that uses his own SSE emulation layer and has apparently got it working on the Raspberry Pi 2.
Re:An LZ Codec Designed for SSE Decompression (2016) by XDirtyPunkX on Friday May 12, 2017 @03:52AM (#14322163)
For anyone wondering, that project is called LZSSE-SIMDe and is available here (https://github.com/nemequ/LZSSE-SIMDe).
Re:An LZ Codec Designed for SSE Decompression (2016) by Andys on Thursday May 11, 2017 @08:39PM (#14320638)
Has anyone seen any work done on a virtual machine bytecode that leans on Intel AVX to do its work in parallel?
Re:An LZ Codec Designed for SSE Decompression (2016) by corysama on Friday May 12, 2017 @04:13AM (#14322231)
This just barely counts, but... The game Destiny uses a custom SIMD VM to script loading constants buffers for their shaders. They mentioned it at GDC this year.

It would be fun to write a SIMD-based VM in Terra P:

Re:An LZ Codec Designed for SSE Decompression (2016) by kobeya on Thursday May 11, 2017 @09:02PM (#14320718)
Many intermediate languages support vector extensions...
Re:An LZ Codec Designed for SSE Decompression (2016) by Andys on Thursday May 11, 2017 @09:13PM (#14320764)
I was referring to actual execution of bytecode in parallel, not just support for vectorized math.
Re:An LZ Codec Designed for SSE Decompression (2016) by sounds on Friday May 12, 2017 @03:07PM (#14326898)
Probably wouldn't work in the general case, as each of the bytecode streams would generate memory accesses that are completely independent.

Not to restate the obvious, but SIMD relies on locality of data access to keep the SIMD unit fed with enough data bandwidth.

Re:An LZ Codec Designed for SSE Decompression (2016) by Ono-Sendai on Thursday May 11, 2017 @09:37PM (#14320855)
Are you counting JITing?