I think the idea is that for many definitions of AGI it should be able to do anything a human does and negotiating the physical world is part of that. It might seem dumb as an intelligence test but would be very economically significant. The difference between a chatbot and being able to tell a bot to build an extension on your house.