That naively assumes that you jump up then fall. They could simply climb up steps and drop down, thus resulting in a net movement. Over time we would move into moon collision orbit.