In constrast to the whole self driving stuff this DL is popular for: User input overrides DL input.
Even if we don't understand deep learning to the degree that we would like, we can observe its safety record and compare it to humans'.
Passive self-driving systems that take over when the human gets distracted/unwell are great because human vision exceeds computers where as computers are always alert. This would capture the case you describe, I think it would also have a massive improvement for when bus/lorry drivers should collapse at the wheel (Elon Musk used this as a valid use case for Tesla auto-pilot in the Tesla Semi unveiling).
However active self-driving systems (e.g. Tesla's auto-pilot) are currently worse because they rely on computer vision and humans to be always alert.
We don't know how humans work and under what conditions they break down, either.