> If I'm an average or above average driver, for example, then it doesn't make sense to have insurance, does it?

You’re waiting at a red light when a drunk driver smashes into you. Your skills as a driver can’t affect the probability of this. It may not be your fault, but someone needs insurance.