Re:Deep Learning and Free Software
by stochastic_monk on Thursday July 26, 2018 @04:47PM
(#17620939)
I was speaking regarding different GPUs. I’d like a framework which generates the fastest code for performing a given task for whatever GPU you have.
MKL’s fft isn’t a huge improvement on fftw with avx512, but its blas is ~3x as fast as openblas currently. And before these open source projects caught up, it was by far the best.
And I agree, they’ve been better about it lately. I was comparing Intel then and Nvidia now.
I don't know a lot about GPU compilation/offload, but I'd expect normally to dispatch to library kernels the way linear algebra frameworks do, given we can't even compile GEMM effectively on CPUs. Sufficiently smart tools always welcome, though.
For a free avx512 BLAS, use the current release of BLIS. OpenBLAS recently gained skx (but not knl) gemm support, but I don't know how good it is as I don't have the hardware.
Intel's free software release seems to me to be rather in their favour compared with other vendors.