Totally agree with your points, but for SSH in particular mosh (https://mosh.org/) specifically answers the issue of SSH responsivity. The client optimistically renders what should happen on the server, and the server confirms when it can.

> I'm working on the side on creating a company and those opinions lead me to choose the harder path of desktop applications which don't need Internet connection for anything that doesn't require it by definition. They're more resilient and comfortable to use. I'll probably fail, but I really can't make any other choice at the moment, I need to at least try and see for myself.

Is that in line with the offline-first movement ? I can only cheer you on this journey, because constant connectivity eats our focus and our planet. I'd love to see what you come up with :)