Re:Ask HN: What are good projects to understand CUDA and GPU...
by singularity2001 on Tuesday October 02, 2018 @05:12AM
(#18119934)
don't waste your time on cuda. Wait until an open artitecture replaces this proprietary clusterf*ck
[ Parent
| on HN ]
Re:Ask HN: What are good projects to understand CUDA and GPU...
by brutus1213 on Tuesday October 02, 2018 @07:50AM
(#18120643)
I disagree partly. Cuda is defacto in DL at the moment, and is very well designed. It has academic roots and the neat ideas shine out.
Why did I say partly? So many optimization layers exist already (e.g. BLAS/cuBLAS). One may not really need to get down to the CUDA level.
Re:Ask HN: What are good projects to understand CUDA and GPU...
by skohan on Tuesday October 02, 2018 @10:25AM
(#18121975)
What if anything does Cuda do better/differently than OpenCL?
Re:Ask HN: What are good projects to understand CUDA and GPU...
by keldaris on Tuesday October 02, 2018 @12:08PM
(#18122922)
CUDA itself does only one thing better - it lets you write kernels in C++ rather than a fairly restrictive subset of C. Far more importantly, it has a large ecosystem of tooling (including excellent profiling tools), libraries, documentation and open source projects out there. Comparatively speaking, OpenCL is a barren landscape.
Re:Ask HN: What are good projects to understand CUDA and GPU...
by codehd7 on Tuesday October 02, 2018 @02:26PM
(#18124307)
SYCL layer/standard adds "C++ Single-source Heterogeneous Programming" for OpenCL:
https://www.khronos.org/sycl/
Re:Ask HN: What are good projects to understand CUDA and GPU...
by keldaris on Tuesday October 02, 2018 @03:32PM
(#18124934)
That it does and there's also plenty of convenience wrappers of various kinds for different languages. Unfortunately, none of that can address the ecosystem issue, which is the one that really matters.
Re:Ask HN: What are good projects to understand CUDA and GPU...
by goldenkey on Tuesday October 02, 2018 @12:15PM
(#18122997)
Cuda has
Cooperative Groups now on Volta and Turing architectures. This allows for synchronization between entire workgroups rather than just locally. So you can pretty much keep your entire job on the GPU even if it involves multiple kernels. Really important for complex jobs where performance is a must.
Re:Ask HN: What are good projects to understand CUDA and GPU...
by twtw on Tuesday October 02, 2018 @04:00PM
(#18125188)
Given that AMDs approach has shifted to implementing cuda (under the name "hip") and providing tools to automatically find/replace cuda to hip, I don't think the cuda api is going anywhere.