News for hackers. Stuff that matters.
Re:Unifying the CUDA Python Ecosystem by jjoonathan on Friday April 16, 2021 @01:23PM (#26836673)
> Julia has first-class support for GPU programming

"First-class" is a steep claim. Does it support the nvidia perf tools? Those are very important for taking a kernel from (in my experience) ~20% theoretical perf to ~90% theoretical perf.

Re:Unifying the CUDA Python Ecosystem by maleadt on Friday April 16, 2021 @01:50PM (#26837018)
Yeah, see this section of the documentation: https://juliagpu.gitlab.io/CUDA.jl/development/profiling/. CUDA.jl also supports NVTX, wraps CUPTI, etc. The full extent of the APIs and tools is available.

Source line association when using PC sampling is currently broken due to a bug in the NVIDIA drivers though (segfaulting when parsing the PTX debug info emitted by LLVM), but I'm told that may be fixed in the next driver.

Re:Unifying the CUDA Python Ecosystem by jjoonathan on Friday April 16, 2021 @01:58PM (#26837116)
Nice! I set a reminder to check back in a month.
Re:Unifying the CUDA Python Ecosystem by klmadfejno on Friday April 16, 2021 @01:28PM (#26836727)
Re:Unifying the CUDA Python Ecosystem by jjoonathan on Friday April 16, 2021 @01:40PM (#26836898)
> CUDAnative.jl also [...] generates the necessary line number information for the NVIDIA Visual Profiler to work as expected

That sounds very promising, but these tools are usually magnificent screenshot fodder yet they are conspicuously absent from the screenshots so I still have suspicions. Maybe I'll give it a try tonight and report back.

Re:Unifying the CUDA Python Ecosystem by maleadt on Friday April 16, 2021 @01:57PM (#26837103)
Here's a screenshot: https://julialang.org/assets/blog/nvvp.png. Or a recent PR when you can see NVTX ranges from Julia: https://github.com/JuliaGPU/CUDA.jl/pull/760
Re:Unifying the CUDA Python Ecosystem by jjoonathan on Friday April 16, 2021 @01:58PM (#26837123)
Thanks! Now I believe! :)