[1] https://en.wikipedia.org/wiki/Authors_Guild,_Inc._v._Google,....
Most data is protected by copyright, but I assume you meant proprietary rather than copyrighted. Using proprietary data might not matter under copyright law, but it does matter in terms of the Debian machine learning policy and DFSG, because the non-free data cannot be shipped in Debian main and thus cannot be used to train a model shipped in main.
If I were into conspiracy theories I'd say that AMDs failure to compete in the GPU/DL space is to do with the relationship between the AMD CEO and the NVIDIA one.
Tensorflow is just awful, as is anything that touches bazel :)
Mind if I ask why?
Fwiw, that sounds like a bug or a misconfiguration; it's absolutely supposed to have better caching behavior than that (and does in the few projects I've used it on, even on a personal laptop). If you're interested in pursuing it further (I'd understand if you aren't; that sounds frustrating), I bet the bazel team would be interested in your report.
Using CUDA also means it wouldn't be considered legitimately free enough, although folks are working on getting AMD ROCm into Debian.
Tensorflow isn't yet in Debian, but there may be folks working on it.
Another problem is that Debian doesn't have the hardware for doing training.
I'd encourage you to talk to the folks on the debian-ai mailing list and IRC channel to discuss these and other issues.
https://lists.debian.org/debian-ai/ ircs://irc.oftc.net/debian-ai