Fair! I implicitly assumed that physics and mathematics are isomorphic (as speculated by Dirac in the essay). And so from this assumption, and my first sentence, the second follows.