News for hackers. Stuff that matters.

A comment on Learning to Optimize Tensor Programs. Parent comment

Re:Learning to Optimize Tensor Programs by namibj on Tuesday May 22, 2018 @05:44PM (#17129669)
I just wanted to caution that one has to be careful what one is comparing against, as the libraries got significant speed improvements over time, without that being widely advertised. So it matters a lot if one compares this library against CuDNN from 1 month ago, or to CuDNN from 2 years ago. The latter is _much_ slower.

The GEMM example was just there as the details of the optimization have been published, unlike most other hand-tuned assembler routines for DNN workloads.

[ Parent | on HN ]
Re:Learning to Optimize Tensor Programs by antinucleon on Tuesday May 22, 2018 @05:47PM (#17129690)
CuDNN v7 was used in the experiments, in the experiments parts each comparison was listed with version or commit number.
[ Parent | on HN ]
Re:Learning to Optimize Tensor Programs by namibj on Tuesday May 22, 2018 @06:27PM (#17129939)
Well, I didn't RTFA. This was not meant to be specific for this article though.
[ Parent | on HN ]