I also simply have small hands. I can't comfortably reach left side of a keyboard with my thumb while holding the phone securely on anything bigger than SE so things like Reachability don't help at all.
Many of us prefer the smaller size that was formerly common. The frustration we have is that 4" displays have completely disappeared from the market, aside from the iPhone SE and a few weird low-end Android phones.
We hear all the time that the market wants bigger phones. But I look at data from analytics sites like Mixpanel and see something different.
https://9to5mac.com/2019/01/09/iphone-xr-usage-overtakes-xs/
This is from January 2019 (I can't find anything newer at the moment).
iPhone XS - 2.89%
iPhone XS Max - 3.65%
iPhone XR - 3.02%
iPhone X - 11.71%
iPhone 8 - 9.81%
iPhone 8 Plus - 10.11%
Total - 41.19%
These are all the latest iPhones. If you look at this year alone, sure, the larger phones are selling more. But back up even one year and 60% of iPhone users have the smaller of the newer phones. The 8 and 8 Plus are nearly at parity.
There's a market for not large phones. It's basically half of Apple's iPhone customers.
I was using iPhone 5, 5S, and SE for over 6 years. This Christmas I switched to XR and I couldn't be happier. I feel like there are so many productivity things I can do on my phone that were annoying before. I use notes, emails, and even Google Spreadsheets much more. I started using the Kindle app for reading and I actually like it. Sometimes, I even prefer it over Kindle (mostly because of what I can do with highlights right away).
The only downside is that a pocket on my favorite jeans isn't big enough. So the phone often has to go inside my backpack.