If nothing else is that because you cannot virtualize Geforce line GPU's, there is no CUDA Direct or NVLINK support etc.
If you are telling me that Google is buying Geforce GPU's and flashing the bios with a custom bios ripped off a Quadro card so they can do PCIe passthrough in a hypervisor and initialize the cards then sorry not buying it.
They use containers to isolate and throttle different tasks/jobs running on the same hardware.
At their scale, virtualization would be significantly wasteful in terms of manageability and overhead.
I'm not talking about running virtual OS, I'm talking about things like rCUDA, GPU direct and RDMA.
But still even for their containers solution they need support for gpu passtrough and vGPU if not they can't run containers.
NVIDIA doesn't allow you to run GeForce cards over a hypervisor.
source?
Edit: "replace" is probably not the right word, this is work that the old systems don't do well, but they aren't throwing out x86 racks for gpus of course. It's just instead of buying more of the same for machine learning applications.