I actually think its worse than driving yourself. Humans are OK at doing a repetitive task non-stop. They're terrible at sitting still doing nothing waiting to quickly spring into action. They fall asleep or their mind wanders. This is something a computer is good at yet we've got it reversed. The car drives along doing mundane things but then hands it over to groggy human right when things really get hairy.

And then there's the skill atrophy. How do you learn to perform in stressful situations? By building up confidence and experience with constant repetition in more mundane ones, which this robs you of.