Re:Triton: Open-Source GPU Programming for Neural Networks
by gnufx on Wednesday July 28, 2021 @05:18PM
(#27989852)
In LLVM or in libomp?
I don't know what omp simd is likely to get you over autovectorization. I know of cases where it was thought necessary (-fopenmp-simd, without -fopenmp) but wasn't with recent GCC.
[ Parent
| on HN ]
Re:Triton: Open-Source GPU Programming for Neural Networks
by dragontamer on Wednesday July 28, 2021 @05:41PM
(#27990100)
Autovectorization has issues with function calls.
"#pragma omp declare simd" applies over a function call, which then allows that function to be used inside of a "#pragma omp for simd" loop.
A few keywords here and there really help the autovectorizer achieve closer to CUDA-like environments (like... actually having your SIMD code extend "through" a function call, so you can start splitting up the work a bit better).
EDIT: Here's an example from Intel's ICC: https://software.intel.com/content/www/us/en/develop/documen...
Re:Triton: Open-Source GPU Programming for Neural Networks
by gnufx on Thursday July 29, 2021 @02:01PM
(#27999451)
I took the example program from the OpenMP standard and built it with GCC 11 -Ofast. -fopt-info said the relevant loop was vectorized. Adding -fopenmp gave more vectorization messages from elsewhere, but I don't have time to figure out the difference from the tree dump (not being good with assembler). Doubtless the directives can help, but you do need to get them right, and I trust GCC more than me!