If your startup doesn't have an assumed hit-rate in the hundreds-of-thousands (or you are not in some computationally-intensive industry), ask yourself why you need to build on the so-called "cloud"? (which is meant for "scaling").

If you don't need the scale, don't build for it. It is like part of the last 10% of the 20% incremental changes you need. Focus on the 80% for now.

Buy yourself like 5 DO (or some VPS) servers, spin up your Docker (other easy-devops tool) containers and push your code.

Then focus on the really hard part, marketing/sales.

Note. I've also heard that AWS is quite expensive (comparatively speaking).