If I were to guess, people enter the elevator and subconsciously just press which floor they want to go to. If you allow deselecting, someone will inadvertently deselect where they want to go to if that button is already selected.