News for hackers. Stuff that matters.
Re:Deep Learning and Free Software by stochastic_monk on Thursday July 26, 2018 @07:25AM (#17616563)
And OpenCL was recently deprecated by OSX, wasn’t it?

Edit: yes. Discussion on hn: https://news.ycombinator.com/item?id=17231593

Re:Deep Learning and Free Software by dragandj on Thursday July 26, 2018 @09:48AM (#17617445)
So what? High-end GPU are used in servers and desktops, which almost exclusively run Linux in this space. The really relevant thing here is hardware (Nvidia vs AMD) and software - Nvidia drivers + CUDA (+ Nvidia's OpenCL) vs AMD drivers + OpenCL.

So far Nvidia does excellent technical work with their hardware + their out of the box CUDA toolkit + support in every major deep learning library. The drawback is that they keep everything closed and they charge a huge premium. AMD has great hardware at good prices but the software side is non-existent and the Linux support goes from bad to worse.

Nvidia is the one having absolute control here and they choose to squeeze the market because they can.

Re:Deep Learning and Free Software by stochastic_monk on Thursday July 26, 2018 @11:15AM (#17618102)
And Nvidia isn’t the only company to do so. Intel had a similar monopoly and squeezed it for all it was worth, while providing the best available scientific computing libraries. I can’t blame them, but I would certainly prefer it if there was a way to generically dispatch optimal code for heterogeneous hardware.
Re:Deep Learning and Free Software by gnufx on Thursday July 26, 2018 @04:30PM (#17620737)
The advantages of MKL (or does that mean something else?) are over-sold. Indeed, I understand the relevant primitives in this context were driven by Pabst's free implementations in libxsmm. I don't know whether "dispatch optimal code for heterogeneous hardware" means chose the SIMD instructions or offload appropriately, but what's missing in whichever case it is?

Intel's free software release seems to me to be rather in their favour compared with other vendors.

Re:Deep Learning and Free Software by stochastic_monk on Thursday July 26, 2018 @04:47PM (#17620939)
I was speaking regarding different GPUs. I’d like a framework which generates the fastest code for performing a given task for whatever GPU you have.

MKL’s fft isn’t a huge improvement on fftw with avx512, but its blas is ~3x as fast as openblas currently. And before these open source projects caught up, it was by far the best.

And I agree, they’ve been better about it lately. I was comparing Intel then and Nvidia now.

Re:Deep Learning and Free Software by gnufx on Friday July 27, 2018 @09:45AM (#17625884)
I don't know a lot about GPU compilation/offload, but I'd expect normally to dispatch to library kernels the way linear algebra frameworks do, given we can't even compile GEMM effectively on CPUs. Sufficiently smart tools always welcome, though.

For a free avx512 BLAS, use the current release of BLIS. OpenBLAS recently gained skx (but not knl) gemm support, but I don't know how good it is as I don't have the hardware.

Re:Deep Learning and Free Software by pjmlp on Friday July 27, 2018 @05:22AM (#17624647)
And Google never supported it on Android, creating their Renderscript dialect instead.