Do you want to focus some significant percentage of your time on managing infrastructure or do you want to focus on making what you sell to customers better?
I know it sounds like marketing and I know there's a point at which the cost of cloud doesn't make sense, but I do believe that that inflection point is pretty low if you're in a field that is moving quickly or are say a new startup and need to get to market with a minimum-viable-product to get an idea off the ground -- what a shame it would be to fumble that opportunity re-inventing the wheel with infrastructure.
Yes
Can you turn off unused instances?
Yes
Can you automatically and seamlessly move to the latest hardware running on-prem?
Yes
Do you want to focus some significant percentage of your time on managing infrastructure...
We spend about 10 minutes per day looking after the stack, with about 4 to 6 hours every 6 weeks looking at if and where we can improve things. We then spend about a week or so in depth once every year roughly evaluating different providers, and we typically end up moving to a different provider, which takes a few days.
...or do you want to focus on making what you sell to customers better?
This (infrastructure) is a big part of what we sell to our customers. What we do (and have been doing for about 15 years) is what you kids appear to be calling "devops" now. I was an early adopter (and discarder) of CFEngine...
Secondly, none of my points were specifically about AWS but they were about cloud in general.