I think what people are missing, is that by the time you build a controller interface, and a screen grabber, and have an AI that can interpret the screen grab, understand and play the game, that this is super incredible, and really the humans are probably already being herded into Soylent Green processing centers to feed the remaining humans that are kept around for maintenance tasks.
And this post is showing you an AI that can look at the screen grab and play the game.
Here to offer praise to the AI overloads. Hope they read my comments later and know I was a true believer and should be included in the maintenance crews they allow to live.
And if that ever becomes a real problem they add a 3D camera to the controller or require it to be positioned below the screen, and use ML to decide if there's a human in front of the machine or not. AI cuts both ways. Integrated hardware devices aren't necessarily easy to just cut into. That's why it's hard to mod consoles to begin with.
If that's true, it must be easily bypassed because keyboard/mouse-to-controller adapters, like the XIM MATRIX, are still around after over a decade and work with the latest consoles (e.g., PS5).