I lived in a high-rise that let you unselect a floor with a double press. Try that next time. Can confirm it's very nice!