I see your point, although I would argue that you could say the same thing about human factors like intoxication. Say there's a big drinking holiday, human-driven deaths go up due to people drink driving. Self-driving cars are immune to that factor.