While that makes sense and I think is 'fair' - car accidents are too dangerous to be something you overlook - it's also too devestating to some people:

They will lose their jobs, and then housing, etc. People need their cars to feed their kids, do all sorts of things. And of course, they will drive illegally if they have to - wouldn't you?