If it had been full of bowling balls and just thunked to the ground, it would not have been the right decision to just drive over it.
I am not talking about any specific case. The difficulty is precisely in creating an autonomous system that is capable of making such embodied decisions. I learned to recognize how a lightweight object behaves with a lifetime of experience. The type of sensory input does not matter for this and if we are trying to train a system that is capable of this kind of deeper modeling of the world it is traveling through then the focus needs to be on building and training of such a system.
Fluttering boxes is just one of an infinite number of such embodied decisions I am able to make as a human living on the planet earth!
>Are you offering up any concrete path towards dealing with the kinds of scenarios that I am presenting?
They don't matter 99.9999% of the time and the rest of the time it's actually better to avoid the obstacle every single time. Kids play in cardboard boxes and die because people's "embodied" view doesn't account for that. Plastic bags wind around the wheel and break the car because people's "embodied" view doesn't see the danger of a plastic bag. Etc, etc. People are overall atrocious unsafe drivers and I'd be surprised if even existing driving system aren't superior to humans in terms of accidents.
A real issue is that the data from existing sensors is less than the data a human gets from our sensors which will leave edge cases that software cannot solve (ie: many Tesla autopilot accidents seem to be this category).