Much like the Amish will probably have a community mobile phone rather than a personal one a good middle ground for the rest of us could be public libraries. Government services and banking typically don't need frequent access so you don't need a personal internet connection just for them.

I'm ashamed to admit I didn't think of this earlier recently when I needed some printing/scanning done. I went and bought a cheap hp cloud printing (they don't even come with cables anymore) abomination. After trying to get that to work, screwing around with HP accounts, configuring a cloud printer from a linux desktop, installing an app on my phone, etc I ended up going to the local library and got it all done in 30 minutes It was cheaper, easier and better option for something I need to do a few times a year.