News for hackers. Stuff that matters.
Re:Optimization Techniques for GPU Programming [pdf] by eachro on Wednesday August 09, 2023 @05:37PM (#37068788)
I've been looking into getting into GPU programming, starting with CS334 (https://developer.nvidia.com/udacity-cs344-intro-parallel-pr...) on Udacity. I'm curious to hear from some of the more seasoned GPU veterans out there, what other resources would be good to take a look at after finishing the videos and assignments?
Re:Optimization Techniques for GPU Programming [pdf] by pengaru on Wednesday August 09, 2023 @06:02PM (#37069030)
https://shadertoy.com is a great way to explore shaders
Re:Optimization Techniques for GPU Programming [pdf] by pjmlp on Thursday August 10, 2023 @05:22AM (#37073824)
Indeed, with the caveat that it is constrained to GL ES 3.0 shader capabilities, minus what was removed for WebGL 2.0.
Re:Optimization Techniques for GPU Programming [pdf] by yzh on Wednesday August 09, 2023 @06:36PM (#37069313)
I would recommend the course from Oxford (https://people.maths.ox.ac.uk/gilesm/cuda/). Also explore the tutorial section of cutlass (https://github.com/NVIDIA/cutlass/blob/main/media/docs/cute/...) if you want to learn more about high performance gemm. OpenAI triton is another good resource if you want to write relatively performant cuda kernels using python for deep learning (https://openai.com/research/triton)
Re:Optimization Techniques for GPU Programming [pdf] by gpuhacker on Wednesday August 09, 2023 @06:37PM (#37069328)
If you want to go really in-depth I can recommend GTC on demand. It's Nvidia streaming platform with videos from past GTC conferences. Tony Scuderio had a couple of videos on there called GPU memory bootcamp that are among the best advanced GPU programming learning material out there.
Re:Optimization Techniques for GPU Programming [pdf] by zetazzed on Thursday August 10, 2023 @12:28AM (#37071949)
100% this. You can find all kinds of detailed topics, like CUDA graphs, memory layout optimization, optimizing storage access, etc. https://www.nvidia.com/en-us/on-demand/. They have "playlists" for things like HPC or development tools that collect the most popular videos on those topics.