At what point is an attentive driver expected to notice that autopilot has silently failed? The video linked at the top of the thread has a <1 second interval between the car failing to follow its lane, and plowing into a concrete barrier.

This is actually harder to do then just driving the car.