Re:AVX-512, what’s useful for us
by chrisseaton on Friday December 22, 2017 @01:19PM
(#15989618)
> For something like bulk matrix multiplications, GPGPU is going to be much better, both in throughput and in operations per joule.
But you have to get all of your matrix out onto the system bus, and over to the GPU, then start the kernel, and then copy it all the way back again, to use that. ZMM is just a register. You can operate on it immediately and stream data from memory while you do the multiply.
But you have to get all of your matrix out onto the system bus, and over to the GPU, then start the kernel, and then copy it all the way back again, to use that. ZMM is just a register. You can operate on it immediately and stream data from memory while you do the multiply.