The problem is a lot of X apps are just built assuming they have these permissions. They have no mechanism to deal with needing to wait for the user to grant this permission. So when you try to do these things in xwayland, you run into undefined behavior.