> On a daily commute for example, if it worked many days in a row, and then fails for some reason (technical, external, whatever), the user will likely fail to notice

Yup. This is why I won't get into a self-driving car until they're fully driverless.

Drivers become less attentive as the system gets better.