My completely unfounded theory is that reading and watching both exercise different portions of the brain, like running and swimming. But like running and swimming, there is a wide spectrum of available exercise intensity - and even in their most intense forms they don’t exercise the whole of the brain.