Yes, maintenance (upgrades, security patches, scaling up instances...) if you're going DIY on AWS is also significant. The time needed for setup + maintenance varies greatly depending on the developer(s) as well as the exact project needs, but at a minimum, Heroku needs to be at least as expensive as AWS minimum costs + bare minimum setup costs before switching to AWS could be considered cost-effective.