A test pseudo-"driver" ought to be doing stuff like orally making notes of the environment and car operation, collecting data the sensors might be missing, and monitoring the car's automated judgement. As a related effect, the human should be ready to emergency brake or swerve.