The point is that most games would probably need a special VR controller (not a normal one!), unless they can be played point&click style. But Apple won't include them, so the respective games won't be made in the first place. There aren't even smartphone games which require external controllers, despite the install base of smartphones being orders of magnitude higher than what the sales numbers for the Vision Pro headset will be.

Moreover, making elaborate games like civilization wouldn't be economically feasible even if they could be appropriately controlled by default. The price for the headset is so high that not many people will buy it. Then elaborate games can't sell enough copies in order to be profitable. For example, it seems unlikely that even a success like Half Life Alyx made its development cost back. The hardware install base is too small.