I use an ancient SIM-free phone and the place I notice the speed issue is never within the applications I use it for (Stellarium, Maps, All Trails, IRS etc). It's switching between applications. Once you're "fully inside" one of the apps, yeah, the speed of this 10 year old device is completely adequate and almost indistinguishable (with these apps at least) from a similar phone today.