Yes, the key here is to understand that you are not exactly flying, but always falling towards something, and you need to change the trajectory of your fall to get anywhere.

So space flight is much closer to sky diving than to air flight.