You don't exactly need to tell me. I have 10^4 machines in multiple clouds right now plus more n datacenters. Cost effective scaling is hard, but you have to design your applications around it.

Tbh, I find most engineering orgs don't have the competency to pull it off.