First thing I have immediate trouble with is the phrasing of AWS which is confusing. Second is their offerings and ux which is also totally confusing. But when you get passed that, you still have to do more configures than in azure. If you do not use Visual Studio (VS) or .NET you can still download the whole deploy profile file you need directly from the app service within Azure.
In Azure, I can create a new project and it will autogenerate the entire profile for me, run my migrations and I can deploy from within visual studio in minutes.
Coming from a "classic open source background", Microsoft has totally won me over. I save so much time with Azure and VS it's crazy.
I have experience of AWS and Azure and personally I just think Azure beats AWS in every aspect.