I think you're generalizing too much. The overhead for bare metal only exists for certain use cases and apps.

We run about 3 cages (~4k pieces of hardware total) for about a tenth of the cost of what we've priced out as AWS/GCP. This includes DC staff to swap/provision hardware, leases, capex, and our bandwidth contracts.