> Seems like theres room in the market for some kind of an On Prem Private Cloud Stack that emulates GCP/AWS etc but locally maybe?

It's more like cloud-in-a-rack, but that's what https://oxide.computer/ is trying to do isn't it?