Full self driving tech is presumably (and by definition) fully able to handle things by itself. We're talking about "partial self driving tech" (SAE L3) which relies on the driver taking over when it doesn't know what to do. The context switching for a regular human absolutely kills the reaction time in these situations making this a "I'll mostly drive myself but when I can't you're almost guaranteed to cause a crash" type issue.