Re:Base64 encoding and decoding at almost the speed of a mem...
by tomsmeding on Wednesday November 06, 2019 @04:04AM
(#21460822)
In the readme for Turbobase64, they state:
> Only the non portable AVX2 based libraries are faster
The paper in OP is about 2 times as fast as their previous AVX2 code. I think they are superior to Turbobase64 here (though with more stringent hardware requirements).
Re:Base64 encoding and decoding at almost the speed of a mem...
by powturbo on Wednesday November 06, 2019 @04:40AM
(#21461007)
I agree and according to a steam hardware survey only 1% are using AVX2. AVX-512 is practically unused. And don't forget the billions ARM CPU's.
Re:Base64 encoding and decoding at almost the speed of a mem...
by sambe on Wednesday November 06, 2019 @06:52AM
(#21461619)
Their numbers are surely wrong? Firstly, AVX2 jumped from 1% to 5% in a month. Secondly, it looks to have been on every Intel processor this decade.
Re:Base64 encoding and decoding at almost the speed of a mem...
by eMSF on Wednesday November 06, 2019 @08:46AM
(#21462450)
Even 5% sounds sketchy indeed. However, AVX2 (or Haswell New Instructions) hasn't quite been on every Intel processor this decade, rather only since the 4th generation (late 2013), and only in Core-branded processors.
Re:Base64 encoding and decoding at almost the speed of a mem...
by colejohnson66 on Wednesday November 06, 2019 @08:57AM
(#21462590)
It’s available, but the CPU would throttle itself to prevent overheating until very recent processors.
Re:Base64 encoding and decoding at almost the speed of a mem...
by cperciva on Wednesday November 06, 2019 @02:37AM
(#21460481)
TurboBase64 runs at 3-4 GB/s. The authors' work runs at over 40 GB/s.
Not to say that Turbobase64 isn't impressive, but it's not at all the same level of performance.
Re:Base64 encoding and decoding at almost the speed of a mem...
by powturbo on Wednesday November 06, 2019 @02:50AM
(#21460526)
40 GB/s in L1 cache. The TurboBase64 benchmark is more practical.
It is impossible to have the speed of a good memcpy when you're copying 33% more like in base64.
Re:Base64 encoding and decoding at almost the speed of a mem...
by bluesign on Wednesday November 06, 2019 @09:11AM
(#21462726)
I think 40GB/s result when it is not fitting L1 cache. If you check result graph, On L1 cache fitting data memcpy is ahead with big difference, then they are almost head to head
Re:Base64 encoding and decoding at almost the speed of a mem...
by powturbo on Wednesday November 06, 2019 @11:21AM
(#21464037)
L1 cache is 64k for this cpu.
A benchmark with large files is more realistic, because it's unlikely that the data already be in the L1 cache.
It is faster than SSE on Intel/AMD and SIMD NEON on ARM see benchmark at Turbo Base64: https://github.com/powturbo/TurboBase64