Yup; if you go with AWS, expect to build a pretty complicated setup distributed over many services. Even the basic LAMP / Wordpress stack mentioned in a sibling comment and often used in tutorials starts at $50 / month once you add everything up, and that's without any traffic.

Although I guess Lightsail would be a lot more affordable.