By the way, I'm not arguing that TV is good for kids. I'm just trying to analyze the argument in favor of preventing infants from watching passive screen media.
A remote doesn't explore causality inside the media, it's only exploring "when I press a certain button it will switch to a different show which is not of my choosing and which I can't predict". They might correllate pressing the same numbers with the same show at the same time of the day. The "camera angle" interactivity in live theater doesn't get into causality at all, just different ways you can look at or listen to a scene, but in videogames causality is rarely so random.
Think of it at a very basic, I-don't-know-what-TV-or-videogames-are level: I press the channel up button on the remote, the image suddenly changes to something entirely different. If I do this a few hours later, the former image and the latter image are entirely different from before. Let's even assume I'm watching Netflix and I've figured out how to navigate menus: the menu is interactive, but the media I'm watching doesn't give me any control over what's happening inside the media. In a videogame, if I press a button a character will move, a gun will shoot, a menu will open. If I do the same thing a few hours from now, the same thing will happen. A different thing might happen in a predictable context: if my dude is in front of a wall he might climb the wall rather than jump when I press A, it's generally bad design to allow otherwise. The link between cause and effect is much more clear, and my role as an agent of cause is much more clear as well.
Live theater allows the user to control what to focus on during each scene. If there is a conversation, we can choose who the "camera" is pointing at. We are also looking at real human beings interacting with each other. The experience is mildly interactive.
Passive screen-based media gives us neither set of choices.