Backtesting a driving model, it’s very hard to tell what would have happened, had the car deviated at all from what the driver did.

e.g. You see the driver swerve for no apparent reason, did the driver simply drive more recklessly than the car would, or did they avoid an obstacle the model didn’t catch?