AMD is working on a cudnn comptability layer iirc (MiOpen) and is ROCm group has created a cuda transpiler (to intermediary HIP then to amd binary via hcc)
https://instinct.radeon.com/en/6-deep-learning-projects-amd-...
Wait, I thought that AMD's cuDNN replacement was hipDNN, now I'm confused https://github.com/ROCmSoftwarePlatform/hipDNN
Edit: OK I was reading the docs, I think I got it: hipDNN is a wrapper that (once finished) will search and replace calls (from cuDNN to hipDNN), then hipDNN itself, in turn, will call MIOpen, not sure if that's right, I would appreciate if someone who knows more could confirm
AMD is always working on random half-assed attempts to get to parity with NVidia for neural network training.
If they'd chosen one approach 5 years ago and put decent resources behind it they might be competitive by now.
Tensorflow uses the cuDNN library, which is closed source. There is nothing for HIP to convert.