Having to rely on playing an arcade game is a weak case in general. We don't call Counter-Strike modders AI researchers. The fear angle is nothing but woo, but I'd like to hear you elaborate nonetheless.
[1] https://github.com/moridinamael/mc-aixi/blob/master/src/pacm...
See, chessboards are meaningless outside of human experience. You only know how to play pac man without explicit instructions because you have a general concept of a game and what games look like when you win or lose them. Whenever you try to solve an AI problem in a narrow domain like this then you necessarily have to compensate by giving it a miniature model of the specific problem being solved.
Humans after all don't just intuitively know the rules of games before playing them. You also cannot just describe the rules of the game to the AI because the AI does not understand language.
MC-AIXI seems to be more generic because it factors this out into a reinforcement learner, but this in of itself is hardly a cause for fear and that AGI is coming, as the GP alluded. I'd wager today's AAA titles have some damned complicated heuristics of their own.