News for hackers. Stuff that matters.

grebnov

Show HN: Libcusort – A radix sort for modern Nvidia GPUs

https://github.com/IlyaGrebnov/libcusort

I wrote a single-header CUDA radix sort library that's 1-6% faster than CUB for 32-bit keys and up to 38% faster for small types.Why bother? CUB's radix sort is already memory-bound, which is theoretically optimal. But CUB's codebase prioritizes backward compatibility and generality across GPU generations, leaving room for targeted optimizations on modern hardware.Benchmarks (RTX 5090, 67M...

( Read More... | no comments | on HN )
Re:Lossless data compression with CUDA acceleration on Sunday January 26, 2025 @03:01PM (#42833466)
I've been working on the high-performance compression library libbsc for a while. It features state-of-the-art block-sorting lossless compression algorithms, optimized for modern hardware, including CUDA acceleration.

In the course of my research, I also developed libsais, a library for fast, linear-time suffix array and Burrows-Wheeler transform construction, and libcubwt, a GPU-accelerated library for suffix array and Burrows-Wheeler transform construction.

But, notably, advancements in block-sorting lossless compression algorithms have been very limited in recent decades. So, I hope to inspire members of the Hacker News Community to explore and advance the field.

The 'Silesia compression corpus' is the standard (albeit outdated) lossless data compression corpus. The English wiki data set does not provide a fully representative comparison, as it does not include other file types such as executables or structured data.
Re:Global Data Compression Competition on Saturday May 13, 2023 @01:30PM (#35930594)
3rd Edition of the Global Data Compression Competition with 177,000 EUR total prize fund.