But they are built on top of nvidia tooling and you can use nvidia tools to do more extensive profiling than other players offer.

True, gotta love Nsight Systems and Compute.

That's the first hurdle of working with AMD GPUs, I have no idea what the GPU is actually doing because there is no quality profiler.

Is Omniperf/Omnitrace not very good? I haven't used it, but I have been using Nsight Systems recently and it looks comparable to me at a glance.

No way would any of those have any have bindings to backend libraries like cuDNN.

Yeah but the frameworks use CUDA in their NVIDIA implementation , don’t they?

That’s ignoring a huge swath of software nvidia uses to push industry forwards (in the direction they want it to go).

Omniverse, Isaac, Metropolis, Rapids, etc.