I’m pretty sure that when the railroads went bust that nobody pulled up the rails and put them somewhere else. And when the internet bust happened, they didn’t pull up all the dark fiber and lay it down somewhere else.

I would bet that if all those GPUs go idle, they stay housed and cooled in the data center they were originally installed in, for better or for worse.