>Isn’t the freedom to walk down the street or go to school without fear of a deranged shooter or accidental firearm discharge an important freedom too?

No. You have no right to not be in fear.

And even using your argument, I feel less in fear walking down the street with "protection" than not, which by your argument strengthens my right to carry.