News for hackers. Stuff that matters.
Re:OneAPI – A cross-industry, open, standards-based unified ... by oivey on Monday March 01, 2021 @08:42PM (#26310916)
Is that not what this is? https://docs.nvidia.com/cuda/cuda-c-programming-guide/index....

I thought this allowed kernels to run in parallel if both kernels could fit in the open resources. It doesn't have a priority system, and I'm guessing isn't smart enough to reorder kernels to fit together better. Further Googling to be sure that they mean parallel AND concurrent didn't turn up much, but Nvidia does appear to mean both.

Re:OneAPI – A cross-industry, open, standards-based unified ... by my123 on Monday March 01, 2021 @09:19PM (#26311192)
cudaStreamCreateWithPriority is what you'd like to use for creating a stream with a specifically defined priority.

The GPU is able to run up to 128 kernels in parallel on modern NVIDIA GPUs, concurrently.

Re:OneAPI – A cross-industry, open, standards-based unified ... by oivey on Monday March 01, 2021 @10:23PM (#26311567)
Ahh ok. I’ve had a similar conversation with a graphics guy that strongly paralleled this conversation, and I was confused then, too. Seemingly the asynchronous compute issues are a limitation when it only comes to shaders I guess? I write some CUDA but no shaders, and certainly not so much that I’d make super concrete claims about more esoteric features like streams.