The problem is that cloud providers build services and solutions outside of simple server space. AWS for example has some killer apps with S3, RDS, ELB, Kinesis, etc. Yes there's open source alternatives for all of those, but they bring on huge operational costs.