The article makes it seem like this is only from training runs or inference; It's not. Compute demand is always growing, and the latest reason for it to grow is the mini-boom ML has created. A lot of that is stuff other than the training or inference, like web servers, databases, etc. this boom has created many new companies, each with their own infrastructure needs.