I’ve had a larger android phone and went to the SE. I’ll hold on to the SE as long as I can, in fact I wish the 3.5 inch form factor was still an option.

I've had an X, 6S, SE, and Pixel 3a. Used the X/6S/3A for 13 days, 7 months, and 13 days, respectively. Each time I went back to the SE because I didn't think the size was worth the inconvenience while walking/running/using public transit/laying in bed/etc. And this even though each of those devices has nicer specs, a better quality screen, better vibration motor, much better camera, etc... those pros just weren't worth the huge con that is the unwieldy size (to me).

So at this point I'm just going to say that not everyone likes the larger size even if they give it a solid try and it comes with other benefits. This applies to other things too: even if a great sandwich is cheaper and more filling than a good salad, some people prefer the salad. Some people like smaller, more spread-out cities where they can drive everywhere; other prefer living in a closet-sized space just so they can walk everywhere. Some people like sedans, others like trucks. Some people like Great Danes, others like Corgis.

I just wish smartphone manufacturers would make corgis again.

Everyone is different. I've switched back and forth between an SE and am XS and the SE is the superior experience for me in pretty much every way.