Oh for sure. And there are clearly great games that can fully utilize VR, such as beat saber. But obviously VR lends itself best to a first person experience (though maybe that doesn't need to be the case) and the best examples of these games (Doom for instance) are not full experiences in VR.
I think a game like Myst with puzzles that you manipulate with your hands could be pretty interesting.