Plus the last mile problem. If the journey to/from spaceports each side takes a few days, the hours of savings w.r.t. air travel won't matter.