I doubt that "physical manipulation" is a requirement for machine intelligence. It may as well be any kind of manipulation in any kind of reach and consistent environment. It could potentially be rich enough virtual environment.

But, in practice, the only "rich enough" environment currently available is the physical world. And virtual classroom is no substitution...