One can say that Google's "on-prem GCP" is Kubernetes. Rolling it on top of bare metal fleet gives you a pretty sweet environment with much greater elasticity or ease of management than OpenStack-like private virtualized clouds. Everything else, like fancy management UIs or monitoring / logging front-ends and highly available databases can nicely run on top of it.

There are tools [1] that make Kubernetes clusters one-click deployable and remotely manageable behind firewalls, which makes MSPs jobs of running Kubernetes on private infra dead-easy.

[1] http://gravitational.com/telekube/

Full disclosure: I work at G and a huge believer in software delivered as a service on private infrastructure.