Re:AVX 512 will be the future
by dragontamer on Monday November 28, 2022 @08:04PM
(#33782307)
That Netflix guy who keeps optimizing their servers keeps coming back every year or so, talking about the latest optimizations he added.
http://nabstreamingsummit.com/wp-content/uploads/2022/05/202...
And a surprising amount of it was in TLS optimizations, in particular, offloading TLS to the hardware (Apparently Mellanox ConnectX ethernet adapters can do AES offload now, so the CPU doesn't have to worry about it).
Since Mellanox ConnectX adapters are trying to solve the AES problem still, I have to imagine that its a significant portion of a lot of server's workloads. Intel / AMD are obviously interested in it enough to upgrade AES to 4x wide in the AVX512 instruction set.
I can't say its particularly useful in any of _my_ workloads. But it seems to come up enough in those hyper-optimized web servers / presentations.
Probably more important, there's a 256 bit version of that instruction. You can get half of that extreme throughput without AVX-512.