As somebody that lives in the downtown of a large city (Toronto) I disagree, though it will obviously depend on the city. There is so much for kids to do. My kid has access to museums, an aquarium, several parks/playgrounds, children's programs, community centres, etc. All this is within a 15 minute walk.