Heroku actually does this for their free instances. They "sleep" servers after iirc 30 minutes of inactivity, and they wake up again after the first request, which takes a few seconds longer as it boots up.