Consider this: if the first accident happens to an average person after 10 years of driving, young people will take a loooong time to build a driving record that can even be considered average let alone good. And you can't start charging higher rates only after the crash, such rates would need to be so high as to be ompletely prohibitive. Bottom line, young people will never be paying as good a price as older people under any system that has a semblance of fairness to it. Sadly.
(This can get into a really long discussion about a lot of things that can correlate with higher accident rates and how sometimes it's a false correlation, like how in some places black people have more accidents, but it's not because they are black but because they are poorer on average and drive older less safe cars - but filtering by race could be used as a quick filter which is, obviously, unfair(and illegal))
Not the same with gender or race, you're stuck with what you're born with (statistically insignificant numbers of transitions notwithstanding).
I think this is a meaningful, if not perfect, distinction.