This reminds me of this nice paper (https://www.biorxiv.org/content/10.1101/055624v2.full.pdf) "Could a Neuroscientist Understand a Microprocessor?" exploring the (nonsensical) results we would get if we'd apply currently used neuroscience approaches to analyze an Atari console running a simple game.