Yes, they were at IAS at the same time, along with Weyl, Einstein, and Godel. I think he met the latter two a few times but did not work with them. He did discuss ideas with Weyl and von Neumann, though.